Automatic publishing should be disabled in the server configuration. Double click on your server name and a configuration page opens. Under the Publish section you should have the Never publish automatically option selected as shown in the following screenshot below. To start the server with JRebel enabled, check the corresponding checkbox (Enable JRebel agent) in JRebel Integration section.
If you run a standalone application you can enable JRebel for its launch configuration.