DATA ENGINEER - PYSPARK / SPARK
Descripción de la oferta de empleo
Your Role and Responsibilities Day-to-day troubleshooting of forecasting systems, mainly working through data anomalies that cause inaccurate forecasts or prevent forecasts' generation.
Collaborate with the data science team to enhance existing forecasting systems for the trade floors.
Create dynamic object-oriented methods, full stack solutions, and integrations to existing code solutions.
Develop individual Python classes, methods, functions that support the data flow of existing and new projects.
Work on code additions to seamlessly support projects for data flows, including logging and support, with little to no supervision.
Experience in modifying packages, testing, and repository instances to support CI/CD.
MXCON24 Required Technical and Professional Expertise 1.
PySpark and Spark.
Proficiency in PySpark, including the Spark DataFrame API and RDD (Resilient Distributed Datasets) programming model.
Knowledge of Spark internals, data partitioning, and optimization techniques is advantageous.
2.
Data Manipulation and Analysis.
Ability to manipulate and analyze large datasets using PySpark’s DataFrame transformations and actions.
This includes filtering, aggregating, joining, and performing complex data transformations.
3.
Distributed Computing.
Understanding of distributed computing concepts, such as parallel processing, cluster management, and data partitioning.
Experience with Spark cluster deployment, configuration, and optimization is valuable.
4.
Data Serialization and Formats.
Knowledge of different data serialization formats like JSON, Parquet, Avro, and CSV.
Familiarity with handling unstructured data and working with NoSQL databases like Hadoop HBase or Apache Cassandra.
5.
Data Pipelines and ETL.
Experience in building data pipelines and implementing Extract, Transform, Load (ETL) processes using PySpark.
Understanding of data integration, data cleansing, and data quality techniques.
Preferred Technical and Professional Expertise NA
Detalles de la oferta
- IBM
- Sin especificar
- 12/12/2024
- 12/03/2025
— межфункциональная работа с командами data science или content engineering для устранения неполадок, обработки или оптимизации критически важных для бизнеса данных... — знание spark — знание scala и/или python — свободное владение хотя бы одним диалектом sql — уровень английского языка: upper-intermediate......
Required/minimum skills/qualifications: minimum 2+ years relevant experience as technical/functional consultant or engineer engineering or master’s degree in computer science/information technology (it) or equivalent relevant product certifications from microsoft excellent communication skills - verbal......
Strong understanding of algorithms and data structuresadvanced experience with ms office and google suite strong quantitative, math, and problem-solving skills... role: sr data scientistlocation: guadalajara & mexico city (remote)type of hire: full time job description: strong proficiency with r, sql......
Importante empresa multinacional de origen suizo esta en búsqueda de tu talento como: project engineer escolaridad: ingeniero mecánico (titulado)... inglés avanzado (la entrevista es en inglés) edad: 26 a 30 años experiencia laboral de 3 a 4 años como mechanical engineer o en ingeniería de proyectos......
Vacante: becario de tableau data science perfil educativo y experiencia:recién egresados o practicantes de ingeniería en sistemas o ingenieras a fines... beneficios:modalidad 100% remotoaumentos salarialesapoyo a oficina en casa a partir del segundo mesbonos de productividadpago de días extras ilimitadosdía......
Must understanding of data repository models is a must... as a full stack engineer assigned to the product/project ensure performance, maintainability, and functional requirements from design, development, testing to rollout and support... ongoing development of our team is central to our innovation......
Essential: graduated industrial engineer or related... customer service quotations and follow-ups search for new customers apqp administration constant communication with international customers prepare, schedule, coordinate and monitor the assigned engineering projects interact daily with the clients......
Requisitos del puestogood knowledge of the architecture of the tandem platform good knowledge in handling tacl macros, obey files, shell script good knowledge in middleware configuration like pathway, mq good knowledge of tcp/ip and socket management... we are looking for an enthusiastic and motivated......
Requisitos del puesto experiencia sólida en atención de incidentes y problemas en infraestructuras de seguridad cisco... reemplazo de partes por falla de hardware... consultoria, elaboración y coordinación de planes de trabajo... connext by migesa forma parte del corporativo migesa quien es uno de los......
Ongoing development of our team is central to our innovation drive... catering to companies of all sizes and industries, including some of the world's largest brands, sonatafy technology is a trusted provider of nearshore enterprise-level cloud and mobile application software development services......
