"App Setting" is included both in Agent Setting and Company Setting. Which one should I set up?

Basically Company Setting is given priority above Agent Setting.

In the case you create a new "Company", the Agent Setting will be reflected to the new Company Setting. 

If you want to change the setting by each company, please set it up selecting a target company.