To invoke firefox in selenium 3, you have to parse -Dwebdriver.gecko.driver=AndPathToGECKOexecutable parameter with the hub

java -jar -Dwebdriver.gecko.driver=geckodriver.exe selenium-server-standalone-3.0.0-beta3.jar -role hub
Make sure the parameter should be before selenium jar