Debugging armcc compiled binary with gdb

I have been trying to convert my Keil project to cmake. I got all the files to compile and to generate a working axf. I'm trying to run debug on the axf with arm-none-eabi-gdb and get the following:

Launching server: "c:\ST\STM32CubeIDE_1.6.1\STM32CubeIDE\plugins\com.st.stm32cube.ide.mcu.externaltools.stlink-gdb-server.win32_1.6.0.202101291314\tools\bin\ST-LINK_gdbserver.exe" "-p" "50000" "-cp" "c:\ST\STM32CubeIDE_1.6.1\STM32CubeIDE\plugins\com.st.stm32cube.ide.mcu.externaltools.cubeprogrammer.win32_1.6.0.202101291314\tools\bin" "--swd"
Launching GDB: "C:\Program Files (x86)\GNU Arm Embedded Toolchain\10 2020-q4-major\bin\arm-none-eabi-gdb.exe" "-q" "--interpreter=mi2"
undefinedC:\Program Files (x86)\GNU Arm Embedded Toolchain\10 2020-q4-major\bin\arm-none-eabi-gdb.exe: warning: Couldn't determine a path for the index cache directory.
Reading symbols from C:\Users\noam.yulzari\Projects\RenalSense\NewSI/build/Main/Main_Program/Main_Program.elf...

warning:
Loadable section "RW_IRAM1" outside of ELF segments

warning:
Loadable section "RW_IRAM2" outside of ELF segments
/mnt/workspace/workspace/GCC-10-pipeline/jenkins-GCC-10-pipeline-48_20201124_1606180641/src/gdb/gdb/dwarf2/read.c:7153: internal-error: cutu_reader::cutu_reader(dwarf2_per_cu_data*, dwarf2_per_objfile*, abbrev_table*, dwarf2_cu*, bool): Assertion `per_objfile->get_cu (this_cu) == nullptr' failed.
A problem internal to GDB has been detected,
further debugging may prove unreliable.

Quit this debugging session?
(y or n) [answered Y; input not from terminal]

This is a bug, please report it.
  For instructions, see:
<www.gnu.org/.../>.
/mnt/workspace/workspace/GCC-10-pipeline/jenkins-GCC-10-pipeline-48_20201124_1606180641/src/gdb/gdb/dwarf2/read.c:7153: internal-error: cutu_reader::cutu_reader(dwarf2_per_cu_data*, dwarf2_per_objfile*, abbrev_table*, dwarf2_cu*, bool): Assertion `per_objfile->get_cu (this_cu) == nullptr' failed.
A problem internal to GDB has been detected,
further debugging may prove unreliable.

I assume the file created by armcc is not supported by GDB, is there a way to make it compatible?