A global asset management firm is actively seeking an experienced Software Developer / Data Engineer to join their growing team in a Senior-level role.
Responsibilities:
- Work a team of data engineers and data architects to acquire data from internal and external sources, ingest into our repositories, and optimize it for data consumptions by end-users
- Implement methods to improve data reliability and quality
- Combine raw information from different sources to create consistent formats
- Develop and test architectures for data extraction and transformation
- Build and maintain optimal data pipeline architectures
- Assembling large and complex data sets, as well as Big Data technologies
- Ensure that data is readily available to data scientists, analysts, and other users
- Perform other duties, as needed
Qualifications:
- 8+ years of experience in developing data acquisition, data ingestion, data transformation, file handling, encryption, sFTP protocol, ETL, ELT workloads on-prem and in the cloud.
- Experience in writing SQL queries, database warehousing: normalization, query optimization, store procedures, views, etc.
- Experience in Python, Java or .Net or C++ to build scripts, data movement applications and integration APIs
Desired Skills:
- Experience using Snowflake
- Experience with APIs, containerization, and Kubernetes.
- Experience with DevOps: Gitlab CI/CD pipelines (both YAML and UI based), Gitlab runners, Terraform for CICD
- Experience with REST APIs, GraphQL, RPC, gRPC, and Webhooks protocols
- Experience with Linux and shell scripting
- Experience with Azure cloud services for APIs, including Azure Functions, Azure API Management, and Azure App Service
- Experience with Containerization technologies, such as Docker and Kubernetes, and their deployments options on Azure: Azure Container App, Azure App Service, Azure Container Instances, and Azure Kubernetes Service
- Experience with best practices for code quality, testing, and performance optimization
- NoSQL databases experience
- Experience with AI/ML concepts and implementations
- Experience with Gitlab Duo
