elastalert-test-rule --alert is working, but not during regular run

[Netherwhal]

When I test a rule with alert, I receive alerts, but not when elastalert is running.

I see new events being logged, but they do not trigger any alert. Logs, server and container are all in UTC.

2024-04-01 21:35:45,845     INFO           elastalert Skipping writing to ES: {'rule_name': 'punishments', 'endtime': '2024-04-01T21:35:45.831250Z', 'starttime': '2024-04-01T21:30:45.831250Z', 'matches': 1, 'hits': 1, '@timestamp': '2024-04-01T21:35:45.845842Z', 'time_taken': 0.014564037322998047}
2024-04-01 21:35:45,846     INFO           elastalert Ran punishments from 2024-04-01 21:30 UTC to 2024-04-01 21:35 UTC: 1 query hits (0 already seen), 1 matches, 0 alerts sent
2024-04-01 21:35:45,846     INFO           elastalert punishments range 300

name: punishments
type: any
index: logs-mcs-punishments

realert:
  minutes: 0

[Netherwhal]

There were several issues:

1. elastalert indices weren't created properly
2. --debug was causing to not send alerts