面議(經常性薪資達4萬元或以上) 台北市內湖區 3年工作經驗 2天前更新
1. Design, develop, and maintain ETL / ELT data pipelines, including data ingestion, parsing, transformation, validation, and export.
2. Modularize, standardize, and automate existing script-based or manual processes, and define clear pipeline interfaces, dependencies, and processing flows.
3. Establish monitoring, logging, error handling, retry, failure recovery, and data validation mechanisms to ensure pipeline reliability and data quality.
4. Analyze and optimize data processing performance, reliability, and scalability.
5. Collaborate with Database Engineers and Automation / DevOps Engineers to integrate databases, NAS / file storage, and workflow orchestration platforms.
6. Create and maintain relevant architecture, interface, operation, and troubleshooting documentation.
展開