Centralized Git Secrets Management: How to Stop AWS Access Keys from Sneaking into Your Repos

Git is your version control system. It tracks changes, stores code, and gives you that sweet rollback freedom. But let’s face it—committing secrets (like AWS access keys) can be a major headache. One slip-up and your keys are exposed, putting your whole infrastructure at risk. How do we solve this?

Sure, there are local tools like Git Secrets, but relying on developers to set that up manually across multiple environments is risky. What you really need is centralized security enforcement—a way to guarantee secrets don’t make it into your repos, no matter who’s working on the code or where they’re pushing from.

Let’s dive into what centralized secret management looks like and how to implement it in a way that keeps your organization’s codebase safe and compliant.


Why Centralized Secrets Management?

Here’s the thing:

You can't just rely on every developer to remember to scan for secrets before committing code. One mistake, and sensitive data is out in the open. Local tools are great for individual developers, but in large organizations, you need to enforce security policies from the center. This guarantees:

  1. No exposed keys, even if a developer forgets to set up their local security tools.

  2. Consistency across all teams and repositories—no exceptions.

  3. Automated enforcement that integrates with your CI/CD pipelines, making security seamless.


Approach 1: Shared CI/CD Pipelines with Secrets Scanning

You can enforce secrets scanning by integrating it into a centralized CI/CD pipeline. Tools like Checkov, TruffleHog, or even AWS CodePipeline with built-in security checks can be used to scan the code before it’s merged into the repository. Here’s what the process looks like:

How It Works:

  • You create a shared CI/CD template that includes a non-skippable stage for secrets scanning.

  • This template ensures that no secrets—like AWS access keys or tokens—get pushed into your codebase, even if someone forgets to run a scan locally.

Implementation Details:

  • Store this pipeline template centrally, in a repository (e.g., GitHub, GitLab) accessible by all teams.

  • Whenever new repositories are created, they inherit this standardized pipeline.

  • Every push or pull request triggers the pipeline, and if secrets are detected, the code is rejected.


Approach 2: GitHub Organization-Wide Policies (Similar to AWS SCPs)

What’s the concept?

Just like AWS SCPs (Service Control Policies), GitHub Organization-wide policies allow you to control what happens across multiple repositories. By setting organization-wide restrictions, you ensure that developers cannot bypass the rules, even if they’re working on different projects.

How It Works:

  • GitHub allows organization administrators to enforce security policies at the organizational level.

  • You can set up a policy to block pushes that contain secrets across the entire organization. This prevents access keys and credentials from making their way into any repo.


Approach 3: Branch Protection Rules with CI Checks

Branch Protection Rules ensure that sensitive information never makes it into production branches without passing the necessary checks. It’s like setting up guardrails—developers can still work in their own branches, but before merging into the main branch, the code must pass CI checks.

How It Works:

  • Create branch protection rules for critical branches like main or production.

  • Require CI checks (like secret scanning) to pass before any code can be merged into the protected branch.

This way, no one can bypass the security checks, and sensitive information remains protected. This rule can be enforced centrally across all repositories in the organization.


Approach 4: GitHub Actions for Secret Management

GitHub Actions can help automate security processes within repositories, and one of the use cases is secret scanning.

How It Works:

  • Set up a GitHub Action that automatically scans for secrets in every push or pull request.

  • GitHub Action checks can include tools like TruffleHog or Checkov, ensuring no secrets are leaked.

  • If the secret scanning fails, the push or pull request is blocked, and the action provides feedback to the developer.

This is a scalable solution as it works across multiple repositories and ensures consistent enforcement.


Approach 5: Branching Out – GitHub vs. GitLab

What’s the difference between GitHub and GitLab?

Both platforms offer CI/CD pipelines and secret detection capabilities. GitLab has native secret detection tools that can be added to your CI pipeline, just like GitHub Actions. However, GitLab’s built-in tools for vulnerability scanning and security checks might offer more comprehensive, out-of-the-box solutions compared to GitHub. Both platforms can integrate with third-party tools like TruffleHog.


What’s Next?

By implementing these centralized solutions, you’re doing more than just preventing secrets from being committed—you’re creating a culture of security. Whether it's through shared CI pipelines, organization-wide policies, or branch protection rules, you can enforce consistency across your entire development process.

GitHub Probot or Husky can automate certain checks, reducing human error. Combine that with secret vaulting solutions like AWS Secrets Manager or GitHub Secrets for storing access keys, and you’ve built a solid, scalable secret management strategy.


Conclusion

Secrets management isn’t just about preventing mistakes—it’s about building a robust, automated system that scales with your organization. By integrating centralized enforcement for secret scanning and making secret detection a non-negotiable part of the CI/CD pipeline, you remove human error from the equation and keep your sensitive data safe.

Now, go ahead and lock down those AWS access keys and make sure secrets never sneak into your Git repos again!

5
Subscribe to my newsletter

Read articles from Tanishka Marrott directly inside your inbox. Subscribe to the newsletter, and don't miss out.

Written by

Tanishka Marrott
Tanishka Marrott

I'm a results-oriented cloud architect passionate about designing resilient cloud solutions. I specialize in building scalable architectures that meet business needs and are agile. With a strong focus on scalability, performance, and security, I ensure solutions are adaptable. My DevSecOps foundation allows me to embed security into CI/CD pipelines, optimizing deployments for security and efficiency. At Quantiphi, I led security initiatives, boosting compliance from 65% to 90%. Expertise in data engineering, system design, serverless solutions, and real-time data analytics drives my enthusiasm for transforming ideas into impactful solutions. I'm dedicated to refining cloud infrastructures and continuously improving designs. If our goals align, feel free to message me. I'd be happy to connect!