Role Objective:
Big Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products
Roles & Responsibilities:
- Sound knowledge in Spark architecture and distributed computing and Spark streaming.
- Proficient in Spark – including RDD and Data frames core functions, troubleshooting and performance tuning.
- Good understanding in object-oriented concepts and hands on experience on Scala with excellent programming logic and technique.
- Good in functional programming and OOPS concept on Scala
- Good experience in SQL – should be able to write complex queries.
- Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.
- Able to mentor new members for onboarding to the project.
- Understand the client requirement and able to design, develop from scratch and deliver.
- AWS cloud experience would be preferable.
- Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services - DynamoDB, RedShift, Kinesis, Lambda, S3, etc. (preferred)
- Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments (preferred)
- Experience in analyzing, re-architecting, and re-platforming on-premises data warehouses to data platforms on AWS (preferred)
- Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements.
- Managing project timing, client expectations and meeting deadlines.
- Should have played project and team management roles.
- Facilitate meetings within the team on regular basis.
- Understand business requirement and analyze different approaches and plan deliverables and milestones for the project.
- Optimization, maintenance, and support of pipelines.
- Strong analytical and logical skills.
- Ability to comfortably tackling new challenges and learn
External Skills And Expertise
Must have Skills:
- Scala
- Spark
- SQL (Intermediate to advanced level)
- Spark Streaming
- AWS preferable/Any cloud
- Kafka /Kinesis/Any streaming services
- Object-Oriented Programming
- Hive, ETL/ELT design experience
- CICD experience (ETL pipeline deployment)
Good to Have Skills:
- AWS Certification
- Git/similar version control tool
- Knowledge in CI/CD, Microservices
About Affine
About
Affine is a pioneering consulting firm that specializes in AI-driven enterprise transformation. With a robust focus on Generative AI, we deliver cutting-edge solutions that redefine industry standards.
Our comprehensive capabilities span the entire analytical value chain, from data to insights and transformation. We provide Cloud Advisory and Assessment, Cloud Migration, Data Lake Design and Development, Big Data Powered Advanced Analytics, AI & Deep Learning Solutions, and Deployment Consulting with Architecture Design.
Company social profiles
Similar jobs
Requirements / Experience:
- Min 4 Years of Experience
- Experience in cross-platform mobile software development (Android/iOS) using technologies such as React Native, Flutter, GO/ Golang, Xamarin, Blazor, JavaScript, TypeScript, Dart, C#
- Familiarity with API Development (REST, Web API, WCF, SOAP)
- Experience with full-lifecycle design, development, and testing of critical business applications
- Good problem-solving skills with attention to detail
- Strong verbal, written, interpersonal, and organizational skills
- Ability to work independently and in a team environment
- Ability to multi-task effectively
- Reliable, highly motivated, with a positive attitude
- Experience with MsSQL, MariaDB
Our client combines Adtech and Martech platform strategy with data science & data engineering expertise, helping our clients make advertising work better for people.
- Act as primary day-to-day contact on analytics to agency-client leads
- Develop bespoke analytics proposals for presentation to agencies & clients, for delivery within the teams
- Ensure delivery of projects and services across the analytics team meets our stakeholder requirements (time, quality, cost)
- Hands on platforms to perform data pre-processing that involves data transformation as well as data cleaning
- Ensure data quality and integrity
- Interpret and analyse data problems
- Build analytic systems and predictive models
- Increasing the performance and accuracy of machine learning algorithms through fine-tuning and further
- Visualize data and create reports
- Experiment with new models and techniques
- Align data projects with organizational goals
Requirements
- Min 6 - 7 years’ experience working in Data Science
- Prior experience as a Data Scientist within a digital media is desirable
- Solid understanding of machine learning
- A degree in a quantitative field (e.g. economics, computer science, mathematics, statistics, engineering, physics, etc.)
- Experience with SQL/ Big Query/GMP tech stack / Clean rooms such as ADH
- A knack for statistical analysis and predictive modelling
- Good knowledge of R, Python
- Experience with SQL, MYSQL, PostgreSQL databases
- Knowledge of data management and visualization techniques
- Hands-on experience on BI/Visual Analytics Tools like PowerBI or Tableau or Data Studio
- Evidence of technical comfort and good understanding of internet functionality desirable
- Analytical pedigree - evidence of having approached problems from a mathematical perspective and working through to a solution in a logical way
- Proactive and results-oriented
- A positive, can-do attitude with a thirst to continually learn new things
- An ability to work independently and collaboratively with a wide range of teams
- Excellent communication skills, both written and oral
Job description:
1. Coordinating and Monitoring the Team Members to ensure that all Deliveries are Prepared and delivered to Customers within Stipulated Timelines.
2. Coordinating with Customers for Data & fee collection, Clarification of Suspense, and getting any Missed/Unclear Document Sets.
3. Scheduling Client Visits with DCs/Negotiators for Data Collection per the Pre-Determined Frequency set with Customers.
4. Escalating to Management any Issues they are Facing with Customers/Team Members.
Required Candidate profile:
1. Any Graduate (Preferably B.Com & M.Com)- Married Women mostly preferable.
2. Experience Working in an Accounts/Audit Office is an Added Advantage.
3. Prior Experience in using any Accounting Software is an Added Advantage.
Location: Hires Remotely Everywhere
Job Type: Full Time
Experience: 3+ years
Salary: INR 7-10 LPA
Key Responsibilities:
- Strong automation QA individual, who can finalize, design and build automation framework from scratch
- Advanced programming skills including automation systems and databases
- Strong knowledge of software QA methodologies, PM tools, and QA
- Familiar with programming script languages including HTML, CSS, Python,
- Hands-on experience with both white box and black box testing
- Expertise in automation tools like Selenium, Pytest, Behave and Cucumber
- Familiar with CI/CD tools like- Jenkins, TeamCity
- Familiar with version control systems like Bitbucket, GitHub
- Experience working in an agile/scrum development process
- Experience in writing clear, concise and comprehensive test plans and test cases
- Detailed knowledge of application functions, bug fixing and testing protocols
- Good written and verbal communication skills
- Excellent analytical skills
- Strong attention to detail
Nice to have:
- Nice to have someone who has very good knowledge of python programming
Responsibilities:
- Design and build advanced hybrid mobile applications using React Native
- Lead the application development effort by being the SPOC
- Build hybrid apps using React Native for Android/iOS
- Publish apps to corresponding App store/Play store
- Implement new technologies to maximize application performance and optimize load time
- Collaborate with the back-end developer to build the RESTful APIs
- Research on emerging technologies and trends
- Participate in the planning and design of future software and technical architectures
Qualifications
- 3+ years of hands on experience in the full life cycle of Hybrid mobile application development including publishing one or more apps to the play store & app store
- Must have developed Hybrid Mobile application using React. Hands on Working experience of React Native is a must.
- Experience developing back-end services preferably with NodeJS.
- Experience in developing apps on native Android/iOS platforms is a plus
- Experience in designing and working with n-tier architectures (UI, Business Logic Layer, Data Access Layer) along with some experience with service-oriented architectures (SOA)
- Strong skills in RESTful web services
- Experience with Agile methodologies would be helpful
The Data Engineering team is one of the core technology teams of Lumiq.ai and is responsible for creating all the Data related products and platforms which scale for any amount of data, users, and processing. The team also interacts with our customers to work out solutions, create technical architectures and deliver the products and solutions.
If you are someone who is always pondering how to make things better, how technologies can interact, how various tools, technologies, and concepts can help a customer or how a customer can use our products, then Lumiq is the place of opportunities.
Who are you?
- Enthusiast is your middle name. You know what’s new in Big Data technologies and how things are moving
- Apache is your toolbox and you have been a contributor to open source projects or have discussed the problems with the community on several occasions
- You use cloud for more than just provisioning a Virtual Machine
- Vim is friendly to you and you know how to exit Nano
- You check logs before screaming about an error
- You are a solid engineer who writes modular code and commits in GIT
- You are a doer who doesn’t say “no” without first understanding
- You understand the value of documentation of your work
- You are familiar with Machine Learning Ecosystem and how you can help your fellow Data Scientists to explore data and create production-ready ML pipelines
Eligibility
Experience
- At least 2 years of Data Engineering Experience
- Have interacted with Customers
Must Have Skills
- Amazon Web Services (AWS) - EMR, Glue, S3, RDS, EC2, Lambda, SQS, SES
- Apache Spark
- Python
- Scala
- PostgreSQL
- Git
- Linux
Good to have Skills
- Apache NiFi
- Apache Kafka
- Apache Hive
- Docker
- Amazon Certification
Roles and Responsibilities
1. Ensuring Proper handling of all queries of students & parents by effective counseling.
2. Shall be responsible for achieving the weekly/monthly admission target of the center.
3. Shall be responsible for delivering impactful sales presentations (Webinars / Seminars) to target groups in nearby colleges and institutions
4. Shall be responsible for completing admission process (documentation), batch formation and executing admissions compliance for students
5. Shall execute Institutional tie-ups with the support of the business development head.
6. Shall execute marketing and brand building activities such as festival participation, event conduction in nearby colleges and institutions to develop lead generation with the marketing head.
7. Shall identify and assess gaps to increase sales / enrollments at the center and meet the revenue goals on monthly basis.
Relevant Experience: 2-6 yrs
- Hands on Experience and manage Node js, Mongo DB, Angular and Express js.
- Architect, Develop, test and deploy robust products that are fast, scalable and highly responsive
- Design and maintain large and complex databases, both relational and non-relational databases.
- Establish, refine and integrate development environment tools and software as needed
- Deploy applications on AWS cloud with ability to quickly debug hosting related issues.
- Expertise in Complete Mean, Node js, Mongo DB, Angular and Express js
- Strong analytical and problem solving skills