Rather than using the .update method, try using .update_cell in order to prevent interpretation of the formula as a string:

def update_formulas(sheet, data):
    for idx in range(2, len(data) + 2):  
        formula = f"=B{idx}*C{idx}"  
        sheet.update_cell(idx, 4, formula)