Senior Data Engineer
RYTE Corporation, Kazakhstan
Job Description
We're a team of physicians, healthcare executives, data scientists and Tech experts committed to empowering anyone, anywhere with the insights they need to make well-informed, healthcare decisions. Through the combined power of AI and big data, we have created the first all-in-one solution that provides our users with everything they need to know about medical professionals and facilities. RYTE transforms the comprehensive data we collect on millions of healthcare providers and medical experts worldwide into knowledge that helps individuals and organizations navigate healthcare systems. Headquartered in Toronto (Canada) and having operations in Canada, France, Kazakhstan, and the Philippines, you will join a truly international, multi-cultural, and dynamic workforce driven toward building something unique and that affects Life and Healthcare on a global scale. For more information about Us, please connect with us at www.ryte.ai.
The Position: Senior Data Engineer
We are looking for a Senior level Data Engineer (Azure) who will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for use across existing products. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing and designing data systems. The Data Engineer will work alongside our data stewards, data scientists, business and data analysts on data and integration initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. He/she must be self-directed and comfortable supporting multiple systems, products and data flows.
This is a full-time position, working at Astana office in Kazakhstan. No remote work for this position. You will be working full time for the Ryte team under the supervision of the Ryte team lead.
This is a fixed-term contract.
The Role:
As a successful candidate, you will bring extensive expertise in the design, framework amp; methodology of data warehousing, and possess experience in the full data life cycle. Additionally, you must possess a unique blend of business and industry savvy; a big-picture vision, and the drive to make that vision a reality. You must enjoy spending time in all business areas to understand their problems and find innovative solutions for the organization.
Responsibilities:
- Manage and mentor less experienced team members by providing counsel and constructive oversight
- Demonstrated abilities to manage, motivate and coach a team of Data engineers
- 2+ years of management/lead experience on Senior or Lead positions
- Understand complex business requirements and providing solutions to business problems
- Defining data engineering best practice and sharing across the organization
- Understand modern data architecture approach including event-driven, data streaming and data mesh
- Create and maintain optimal data pipeline architecture
- Set technical direction by designing solutions to complex problems
- Improve the performance, observability, and reliability of our data pipelines.
- Work with large, complex financial data sets that require sophisticated processing and transformation.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build resilient and maintainable infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
- Work as part of an Agile development team with stakeholders to develop new features to support their data infrastructure needs.
- Work with data and analytics experts to strive for greater functionality in our data systems.
- Manage and mentor less experienced team members by providing counsel and constructive oversight
Requirements
- Bachelor’s degree in Engineering/Computer Science
- Strong experience using the modern Data Warehousing solutions, preferably cloud solutions
- Agile methodology experience essential
- Experience applying modern data management frameworks and methods
- Excellent documentation skills
- Technical project/change management
- Strong understanding of RDBMS and NoSQL databases
- Demonstrated abilities to manage, motivate and coach a team of Data engineers.
- Experience working with Graph databases is a plus
- One or more in each of these categories:
- ETL: Spark, Azure Data Factory, DBT, pandas, Kafka Streams
- Queues and Stream processing: Spark Streaming; Event Hub; Kafka.
- NoSQL: Cassandra, Azure Cosmos, Elasticsearch, MongoDB
- Programming Languages: Python, SQL, Spark (S