Data Engineer (Senior/Leader)
TECHVIFY SOFTWARE., JSC
Mô tả công việc
Build ingestion workflows for APIs, web data, and files. Handle structured and semi-structured formats (JSON, XML, HTML, CSV). Apply resilient scraping practices, including session handling, proxies, and request automation. Ensure compliance with security and access restrictions when integrating external data sources. Optimize SQL queries and transformations for analytics. Design, build, and maintain robust Python-based data pipelines. Implement testing frameworks and good engineering practices for reliability. Ensure data quality, consistency, and scalability across workflows.
Yêu cầu công việc
3 years of professional experience in Python or data engineering and workflow automation. Strong proficiency in Python programming, with experience writing production-grade code Good understanding of basics in data science, machine learning, and deep learning Hands-on experience with Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) Proven ability to design and implement LLM-powered automation solutions Experience with building ML/AI solution endpoints, e.g., using FastAPI Familiarity with Docker for containerization and deployment Experience with Git for version control and collaborative development Knowledge of Azure Cloud, especially Azure AI Foundry Ability to develop test cases, perform testing, and report test results Strong attention to detail in technical documentation and solution design Good command of spoken and written English (comfortable joining calls and writing technical documents)
Quyền lợi
Salary: Negotiation Join a global team and work directly with many talents around the world. Opportunities for onsite work in Japan, Singapore, Australia, and many other countries. Work and grow in a dynamic, creative, and professional environment. Healthcare: Premium Health Insurance TECHVIFY Care 13 months’ salary per year. Annual salary evaluation. Sponsor and encourage staff to study courses by covering tuition fees, such as Udemy, Coursera.