If each line of your file.jsonl is a valid JSON object, run:

jq -s '.' file.jsonl > output.json 

• -s (or --slurp) tells jq to read the entire input stream into a JSON array.