Can I remove computer(s) from the "Default" group?

No, until IT admin assigns the computer(s) to another newly created groups,  it will always default to the "Default" group.