Data Scientist / Data Science Intern

Experience - 10+ Years

Location: Remote

Shift: IST/UK

Key Responsibilities

Architect and lead Apache NiFi-based integration solutions on Azure

Design secure, scalable data ingestion and orchestration pipelines

Set up and manage NiFi clusters (HA, failover, Zookeeper)

Define flow design standards, naming conventions, and governance

Optimize performance (throughput, back pressure, memory, latency)

Implement Azure-native integrations, including:

Azure Blob Storage / ADLS

Azure SQL / SQL Server

Azure Service Bus / Event Hubs

Enable secure integration with .NET APIs and backend services

Collaborate with .NET, Angular, DevOps, and data teams

Establish CI/CD pipelines for NiFi deployments

Mentor NiFi developers and conduct design/code reviews

Own production stability and reduce operational risk

Required Skills & Experience

8–12 years overall experience in data engineering / system integration

4+ years hands-on Apache NiFi in production environments

Strong experience with:

NiFi processors, controller services, flow patterns

NiFi clustering, Zookeeper, HA strategies

Error handling, retries, back pressure, prioritization

Strong Azure experience:

Azure Blob Storage / ADLS Gen2

Azure SQL / SQL Server

Azure Service Bus or Event Hubs

Experience integrating NiFi with:

.NET Core / .NET APIs

RESTful services

Relational databases (SQL Server)

Solid Linux and scripting knowledge

Working knowledge of security, RBAC, TLS, encryption

Good to Have

Azure DevOps pipelines

Docker / Kubernetes (AKS)

NiFi Registry

Exposure to Angular-driven frontends (integration perspective)

Experience in regulated environments (audit, compliance)

Primary Skills– Apache NiFi,

Secondary Skills – Azure Service Bus, Blob Storage

• It is a Full Time ఐటి / సాఫ్ట్వేర్ / డేటా విశ్లేషక job for candidates with 6+ years of experience.