Libretro core: ** stack smashing detected ** error on Linux Ubuntu/Lubuntu/Mint

[deusX1]

Hello,
Gearboy core (latest release 3.6.1) crashes on my Linux PC (Ubuntu/Mint) with a stack smashing error, but works flawlessly on Windows (same PC) and MacOS.

To be precise, the core is initialized correctly without errors in retro_init(), as well as any GB rom loads correctly in retro_load_game(). The problem arises after the invocation of retro_run().

I'm running the core in a new frontend I recently developed, it works great on a m1 macmini as well as on windows PC.
All the other cores I tested works well under Linux, I encountered this issue only for Gearboy.

Hopes it can help, or to fix the issue on my side if that's the case.

[drhelius]

Thanks for reporting.

I'm assuming the error is in the libretro core only? Could you try the standalone?

If you can compile from sources you can try make DEBUG=1.

This will output more traces. If you can share the traces since the startup of the core it would be great.

[deusX1]

Ok, I will test the standalone version first and will provide the result. thanks.

[drhelius]

Just tested in my Ubuntu box both standalone and libretro with RetroArch and it works.

If you can't run it in a debugger you can try adding "printfs" between function calls in retro_run to see how far it goes.

Does it always happen or just with a specific rom?

[deusX1]

Just tested in my Ubuntu box both standalone and libretro with RetroArch and it works.

If you can't run it in a debugger you can try adding "printfs" between function calls in retro_run to see how far it goes.

Does it always happen or just with a specific rom?

It always happen with any rom.

For the test, yes I can confirm it works as standalone.
I will try the core in retroarch and to put some prints as you suggested.