Pymarl is not strictly decentralized execution

[guangyang9543]

Neural network parameters can be shared, but inputs and hidden state should be private to the agent. e.g., pymarl/src/controllers/basic_controller.py

agent_outs, self.hidden_states = self.agent(agent_inputs, self.hidden_states)

It is essentially a full communication framework.