The ability to grant friendship to members of specific class template specializations (using template argument deduction) was introduced - or rather, clarified - in CWG1862 as a defect report. As of this writing, none of GCC1, Clang2, or MSVC has implemented this functionality (CE).
1 C++ Defect Report Support in GCC.
2 C++ Defect Report Support in Clang.