It is hard to use Scrum in SAP implementation since the SAP Methodology is tightly coupled to the implementation process and it is very Waterfall. What you can do is to use Scrum on every phase and deliver incremental product which SAP Methodology ask for. On the first phase you might be only delivering data migration and documentation. You might not deliver a working software until the implementation phase but this is the best you can do.
SCRUM has been adopted by many organizations today to developing/implement complex software products. Although many can answer this question, personally i feel it is very effective because you can be creative with it.
As a scrum master your role is to foster the adoption of Scrum in your ogranisation. I would explore options of Component or feature based teams. Keep your team cross-functional and implement a process that will help for your team/organization.