The simplest way is to use HTML. Swing components support basic html.
DefaultModel table_model = (DefaultTableModel) tblMyTable.getModel();
String cell = "<html><font color='red'>This is red</font></html>";
Object[] row = {cell,"Another cell"};
table_model.addRow(row);