Cloud Data & AI Platform Engineer - Software Engineer 4

Job Description

Job Description

Immediate W2 contract position available in Birmingham, AL.
Estimated Duration: 7 months

• Focus for this position is in AI application development - specifically utilizing DataBricks with an MS Azure lakehouse framework. Software Engineers design and implement sophisticated products using the latest and most advanced engineering technologies in the industry.
• The Cloud Data & AI Platform Engineer is a hands-on technical role responsible for designing, building, and operating advanced data and AI orchestration capabilities within the company's Azure/Databricks-based Lakehouse environment. This role focuses on enabling reliable, governed, and auditable automation of data and analytics workflows using Azure Databricks and related Azure services.
• The position supports the company by developing orchestration frameworks, AI-enabled processing pipelines, and integration services that extend beyond traditional ETL, while remaining compliant with regulatory, security, and cost-management standards expected in a nuclear operating environment.
• This role partners closely with data engineering, analytics, and application teams to ensure that AI-enabled solutions are production-ready, maintainable, and aligned with enterprise architecture standards.

Desired Qualifications:

• 10 + Years
• Has fundamental knowledge of software engineering utilizing Web-based or Object-Oriented Technologies, including .NET and Java.
• Requires good troubleshooting skills, and experience with large-scale distributed system environments.
• Has fundamental knowledge of software engineering utilizing Web-based or Object-Oriented Technologies, including .NET and Java.

Professional Experience

• 5+ years of experience in software engineering, cloud platform engineering, or data engineering roles.
• Demonstrated experience delivering production-grade data or analytics solutions in an enterprise environment.
• Experience in the energy, utilities, nuclear, or other highly regulated industries is strongly preferred.
• Exposure to handling sensitive operational, telemetry, or regulatory data is a plus

Core Technical Skills

• Python: Advanced proficiency, including object-oriented design and asynchronous or event-driven patterns.
• Data Engineering: Strong experience with PySpark, Delta Lake, and enterprise data lake architectures.
• Azure Platform: Practical experience with Azure services such as:
• • Azure Databricks
  • Azure Functions and/or Logic Apps
  • Azure Container-based services (as applicable)
• AI Enablement: Experience implementing AI-assisted or LLM-enabled workflows using structured orchestration patterns (e.g., task-based agents, supervisor/worker models).

Platform & DevOps

• Experience with CI/CD pipelines using GitHub Actions or Azure DevOps.
• Familiarity with infrastructure-as-code or environment configuration management in Azure.
• Strong understanding of secure development practices in regulated environments.

Performance & Operating Expectations

• Accuracy & Auditability: Solutions must be reliable, traceable, and verifiable to support regulatory and operational requirements.
• Scalability & Resilience: Designs must tolerate variable workload patterns without manual intervention.
• Documentation & Standards Compliance:
• Code adheres to PEP 8 and Southern Company development standards.
• Comprehensive docstrings, READMEs, and architectural artifacts are required.

Key Responsibilities

• Data & AI Orchestration Engineering
• Design and implement reusable orchestration frameworks in Python to manage multi-step analytics, data quality checks, and AI-assisted workflows.
• Develop controlled agent-based or task-specialized components to support activities such as data validation, metadata enrichment, code generation assistance, and operational diagnostics.
• Ensure orchestration logic is deterministic, testable, and suitable for regulated production environments.
• Azure Databricks Platform Integration
• Deploy and operate orchestration and AI-enabled workloads within Azure Databricks, leveraging:
• Delta Lake and Medallion Architecture (Bronze/Silver/Gold)
• Databricks Workflows and Jobs
• Unity Catalog for data governance and access control
• Partner with Lakehouse platform leads to align solutions with SNC architectural standards.
• System & API Integration
• Design and implement secure integration patterns with internal SNC applications and approved external vendor systems.
• Ensure integrations follow enterprise security, identity, and data-handling requirements, including auditability and least-privilege access.
• Performance, Cost, and Reliability Management
• Monitor and optimize Spark workloads, orchestration processes, and AI service calls to ensure efficient resource utilization.
• Apply cost-awareness principles consistent with Southern Company AR/CO and cloud financial management expectations.
• Build solutions that can scale to intermittent high-volume workloads while remaining operationally stable.
• Technical Leadership & Standards
• Contribute to architectural guidance, design reviews, and technical standards for data and AI solutions in the Lakehouse.
• Ensure solutions are modular, maintainable, and aligned with long-term platform strategy.
• Provide clear documentation and handoff materials to support ongoing operations and support teams.
• Provide high-level application support
• Problem determination and resolution
• Coding and debugging
• Installing and updating software
• Providing 24x7 technical support
• Designing, creating, testing, and modifying programs
• Handling special projects
• Designing, developing, and implementing software solutions
• Reviewing and recommending products
• Developing technical specifications
• Developing new systems and programs

We provide supplemental employees to the region's most sought after power projects. We credit our success to the commitment we show to our job applicants. E Group Recruiters are here to make sure your job search experience is the best it can be. Our recruiters are experts in knowing what the client manager is looking for in a resume, what bill rate the market will bear, and how to make your application stand out among the rest. Our personal touch continues even after we've found the perfect job for you. All full-time employees are eligible to pay for full health and retirement benefits including BC/BS health and dental insurance, life and disability insurances, and 401K with an immediately vested match is available. We have a dedicated team to guide you through these benefits.

Company Description

We provide supplemental employees to the region's most sought after power projects. We credit our success to the commitment we show to our job applicants. E Group Recruiters are here to make sure your job search experience is the best it can be. Our recruiters are experts in knowing what the client manager is looking for in a resume, what bill rate the market will bear, and how to make your application stand out among the rest. Our personal touch continues even after we've found the perfect job for you. All full-time employees are eligible to pay for full health and retirement benefits including BC/BS health and dental insurance, life and disability insurances, and 401K with an immediately vested match is available. We have a dedicated team to guide you through these benefits.