So I believe I have solved this now. Just took me a few more tweaks then I started to see my results I was looking for.

<?php
    $Url = 'https://serverquery.exfil-stats.de/';
    $json = file_get_contents($Url);
    $arr = json_decode($json, true);
    $json = $arr["servers"];
    
    foreach($json as $key){
        echo "<tr>";
        echo "<td>".$key["name"]."</td>";
        echo "<td>".$key["players"]."/".$key["maxPlayers"]."</td>";
        echo "<td>".$key["map"]."</td>";
        echo "<td>".$key["address"]."</td>";
        echo "<td>".$key["gamePort"]."</td>";
        echo "<td>".$key["queryPort"]."</td>";
        echo "<td>".$key["buildId"]."</td>";
        echo "</tr>";
    }
?>

I got this to work this way, if there is a better way or more practical way please let me know :)