Found the issue. Apparently, one of the parameters on the form for the Athena Datasource configuration was pre-filled but not being sent to the back-end. Had to manually delete and retype a character and submit the form for the connection to succeed.
The parameter was the Default Catalog. This seems to be fixed on the latest Growthbook version