Do I need to create AWS EC2 instance with Graviton processors to build a Docker image for Arm?
AWS CodeBuild will create all of the needed infrastructure automatically, there is no need for EC2.
You can run Docker images created in AWS CodeBuild on any Arm machine with Docker installed.