World's Best AI Learning Platform with profoundly Demanding Certification Programs
Designed by IITian's, only for AI Learners.
6 years Bengalore 4-8LPA
Data engineer not only build data pipelines to efficiently and reliably move data across systems and should be top of latest architectural trends on cloud and on-prime. Folks who understands parallel and distributed processing, storage, concurrency, fault tolerant systems. Folks who thrive on new technologies, able to adapt and learn easily to meet the needs of next generation engineering challenges. Technical Skills, Applied experience with distributed data processing frameworks - Apache Spark or Hadoop and other bigdata technology stack. Applied experience with messaging/event-based systems-Apache Kafka, MQTT etc. Applied experience with SQL scripting, CRUD operations in NoSql databases (like HBase/Cassandra) and time series databases. Applied experience with Elasticsearch indexed storage and mapping. Applied experience with designing and developing CI/CD data pipelines. Proficiency in anyone programming language Java and/or Python and/or Scala. Cloud exposure AWS, Azure etc..