Link errors

[GasparVardanyan]

Describe the bug

Compiling sdk (as specified in README) on ArchLinux I'm getting these errors:

/usr/bin/ld: ../../crt/aws-crt-cpp/crt/aws-c-io/libaws-c-io.a(epoll_event_loop.c.o): in function `aws_event_loop_thread':
/home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/linux/epoll_event_loop.c:620:(.text+0xc50): undefined reference to `__itt_task_begin_ptr__3_0'
/usr/bin/ld: /home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/linux/epoll_event_loop.c:651:(.text+0xd77): undefined reference to `__itt_task_begin_ptr__3_0'
/usr/bin/ld: /home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/linux/epoll_event_loop.c:653:(.text+0xdef): undefined reference to `__itt_task_end_ptr__3_0'
/usr/bin/ld: /home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/linux/epoll_event_loop.c:656:(.text+0xe37): undefined reference to `__itt_task_end_ptr__3_0'
/usr/bin/ld: /home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/linux/epoll_event_loop.c:665:(.text+0x10db): undefined reference to `__itt_task_begin_ptr__3_0'
/usr/bin/ld: /home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/linux/epoll_event_loop.c:667:(.text+0x1148): undefined reference to `__itt_task_end_ptr__3_0'
/usr/bin/ld: ../../crt/aws-crt-cpp/crt/aws-c-io/libaws-c-io.a(stream.c.o): in function `aws_input_stream_read':
/home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/stream.c:36:(.text+0x2da): undefined reference to `__itt_task_begin_ptr__3_0'
/usr/bin/ld: /home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/stream.c:38:(.text+0x341): undefined reference to `__itt_task_end_ptr__3_0'
/usr/bin/ld: ../../crt/aws-crt-cpp/crt/aws-c-io/libaws-c-io.a(tracing.c.o): in function `aws_io_tracing_init':
/home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/tracing.c:15:(.text+0xc): undefined reference to `__itt_domain_create_ptr__3_0'
/usr/bin/ld: /home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/tracing.c:16:(.text+0x2d): undefined reference to `__itt_string_handle_create_ptr__3_0'
/usr/bin/ld: ../../crt/aws-crt-cpp/crt/aws-c-io/libaws-c-io.a(epoll_event_loop.c.o): in function `aws_event_loop_thread':
/home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/linux/epoll_event_loop.c:620:(.text+0xc50): undefined reference to `__itt_task_begin_ptr__3_0'
/usr/bin/ld: /home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/linux/epoll_event_loop.c:651:(.text+0xd77): undefined reference to `__itt_task_begin_ptr__3_0'
/usr/bin/ld: /home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/linux/epoll_event_loop.c:653:(.text+0xdef): undefined reference to `__itt_task_end_ptr__3_0'
/usr/bin/ld: /home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/linux/epoll_event_loop.c:656:(.text+0xe37): undefined reference to `__itt_task_end_ptr__3_0'
/usr/bin/ld: /home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/linux/epoll_event_loop.c:665:(.text+0x10db): undefined reference to `__itt_task_begin_ptr__3_0'
/usr/bin/ld: /home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/linux/epoll_event_loop.c:667:(.text+0x1148): undefined reference to `__itt_task_end_ptr__3_0'
/usr/bin/ld: ../../crt/aws-crt-cpp/crt/aws-c-io/libaws-c-io.a(stream.c.o): in function `aws_input_stream_read':
/home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/stream.c:36:(.text+0x2da): undefined reference to `__itt_task_begin_ptr__3_0'
/usr/bin/ld: /home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/stream.c:38:(.text+0x341): undefined reference to `__itt_task_end_ptr__3_0'
/usr/bin/ld: ../../crt/aws-crt-cpp/crt/aws-c-io/libaws-c-io.a(tracing.c.o): in function `aws_io_tracing_init':
/home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/tracing.c:15:(.text+0xc): undefined reference to `__itt_domain_create_ptr__3_0'
/usr/bin/ld: /home/gaspar/sdk-workspace/aws-iot-device-sdk-cpp-v2/crt/aws-crt-cpp/crt/aws-c-io/source/tracing.c:16:(.text+0x2d): undefined reference to `__itt_string_handle_create_ptr__3_0'
collect2: error: ld returned 1 exit status
make[2]: *** [eventstream_rpc/tests/CMakeFiles/EventstreamRpc-cpp-tests.dir/build.make:176: eventstream_rpc/tests/EventstreamRpc-cpp-tests] Error 1
make[1]: *** [CMakeFiles/Makefile2:2088: eventstream_rpc/tests/CMakeFiles/EventstreamRpc-cpp-tests.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
collect2: error: ld returned 1 exit status
make[2]: *** [devicedefender/tests/CMakeFiles/IotDeviceDefender-cpp-tests.dir/build.make:146: devicedefender/tests/IotDeviceDefender-cpp-tests] Error 1
make[1]: *** [CMakeFiles/Makefile2:2251: devicedefender/tests/CMakeFiles/IotDeviceDefender-cpp-tests.dir/all] Error 2
make: *** [Makefile:146: all] Error 2

Full log: http://sprunge.us/INMUSM

Expected Behavior

To be able to compile the sdk.

Current Behavior

I can't compile sdk because of link errors.

Reproduction Steps

Get a working ArchLinux environment and follow the steps in readme.

Possible Solution

Link ittapi.

Additional Information/Context

No response

SDK version used

current 'main' branch

Environment details (OS name and version, etc.)

Linux odyssey 6.6.8-arch1-1 #1 SMP PREEMPT_DYNAMIC Thu, 21 Dec 2023 19:01:01 +0000 x86_64 GNU/Linux

[GasparVardanyan]

Full process of building: http://sprunge.us/gJ8adS

[GasparVardanyan]

I've builded and installed ittapi manually and in my case these changes helped to successfully build the sdk:

diff --git a/devicedefender/CMakeLists.txt b/devicedefender/CMakeLists.txt
index 4040ca7..62161ac 100644
--- a/devicedefender/CMakeLists.txt
+++ b/devicedefender/CMakeLists.txt
@@ -101,7 +101,7 @@ if (BUILD_DEPS)
     endif()
 endif()
 
-target_link_libraries(IotDeviceDefender-cpp IotDeviceCommon-cpp)
+target_link_libraries(IotDeviceDefender-cpp IotDeviceCommon-cpp /usr/local/lib/libittnotify.a)
 
 install(FILES ${AWS_IOTDEVICEDEFENDER_HEADERS} DESTINATION "include/aws/iotdevicedefender/" COMPONENT Development)
 
diff --git a/eventstream_rpc/CMakeLists.txt b/eventstream_rpc/CMakeLists.txt
index 5e5aa13..1e41fd5 100644
--- a/eventstream_rpc/CMakeLists.txt
+++ b/eventstream_rpc/CMakeLists.txt
@@ -98,7 +98,7 @@ if (NOT IS_SUBDIRECTORY_INCLUDE)
 endif()
 
 
-target_link_libraries(EventstreamRpc-cpp ${DEP_AWS_LIBS})
+target_link_libraries(EventstreamRpc-cpp ${DEP_AWS_LIBS} /usr/local/lib/libittnotify.a)
 
 install(FILES ${AWS_EVENTSTREAMRPC_HEADERS} DESTINATION "include/aws/eventstreamrpc/" COMPONENT Development)

[jmklix]

I'm glad you were able to get this working for your environment. Are you running into any other build issues?

[GasparVardanyan]

Thank you for quick response. That was the only issue.

[bretambrose]

This should be investigated further. A user needing to patch the source tree isn't a situation we want to be in.

[GasparVardanyan]

Also in mqtt5 pubsub example was that problem.

diff --git a/devicedefender/CMakeLists.txt b/devicedefender/CMakeLists.txt
index 4040ca7..62161ac 100644
--- a/devicedefender/CMakeLists.txt
+++ b/devicedefender/CMakeLists.txt
@@ -101,7 +101,7 @@ if (BUILD_DEPS)
     endif()
 endif()
 
-target_link_libraries(IotDeviceDefender-cpp IotDeviceCommon-cpp)
+target_link_libraries(IotDeviceDefender-cpp IotDeviceCommon-cpp /usr/local/lib/libittnotify.a)
 
 install(FILES ${AWS_IOTDEVICEDEFENDER_HEADERS} DESTINATION "include/aws/iotdevicedefender/" COMPONENT Development)
 
diff --git a/eventstream_rpc/CMakeLists.txt b/eventstream_rpc/CMakeLists.txt
index 5e5aa13..1e41fd5 100644
--- a/eventstream_rpc/CMakeLists.txt
+++ b/eventstream_rpc/CMakeLists.txt
@@ -98,7 +98,7 @@ if (NOT IS_SUBDIRECTORY_INCLUDE)
 endif()
 
 
-target_link_libraries(EventstreamRpc-cpp ${DEP_AWS_LIBS})
+target_link_libraries(EventstreamRpc-cpp ${DEP_AWS_LIBS} /usr/local/lib/libittnotify.a)
 
 install(FILES ${AWS_EVENTSTREAMRPC_HEADERS} DESTINATION "include/aws/eventstreamrpc/" COMPONENT Development)
 
diff --git a/samples/mqtt5/mqtt5_pubsub/CMakeLists.txt b/samples/mqtt5/mqtt5_pubsub/CMakeLists.txt
index b2d6dda..5fd9912 100644
--- a/samples/mqtt5/mqtt5_pubsub/CMakeLists.txt
+++ b/samples/mqtt5/mqtt5_pubsub/CMakeLists.txt
@@ -22,4 +22,4 @@ endif ()
 
 find_package(aws-crt-cpp REQUIRED)
 
-target_link_libraries(${PROJECT_NAME} AWS::aws-crt-cpp)
+target_link_libraries(${PROJECT_NAME} AWS::aws-crt-cpp /usr/local/lib/libittnotify.a)

[GasparVardanyan]

I build the sdk with -DBUILD_SHARED_LIBS=ON flag and I get libaws-c-iot.so.0unstable, libaws-c-s3.so.0unstable files in the lib folder. Then when I link the sdk to my project, compile and run, I get runtime errors related to that files.
I think the lib folder isn't a right place for ".so.0unstable" files.

In whole Arch+BlackArch package repos only in AWS sdk appear files like that:

-> [ ~ ] :: pkgfile -r 0unstable
extra/aws-c-s3
-> [ ~ ] :: cd -

[GasparVardanyan]

The itt related error happens in samples as well. Currently this command helps to fix the problem and build the sdk and the samples (when ittapi library is located at /usr/local/lib/libittnotify.a):

rg --files | rg CMakeLists | xargs sed 's#\(target_link_libraries(.*\))$#\1 /usr/local/lib/libittnotify.a)#' -i

[bretambrose]

I am not able to repro this using a container based on archlinux:latest.

If you can attach (as a file/download) the output you get from the initial cmake invocation with --trace-expand included on the command line that might give some useful information. The vtune integration is off by default based on this flag here: https://github.com/awslabs/aws-c-common/blob/main/cmake/AwsCFlags.cmake#L13