1. Communicate with the clients and understand their business requirements.
2. Build, train, and manage your own team of junior data engineers.
3. Assemble large, complex data sets that meet the client’s business requirements.
4. Identify, design and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
5. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources, including the cloud.
6. Assist clients with data-related technical issues and support their data infrastructure requirements.
7. Work with data scientists and analytics experts to strive for greater functionality.
Skills required: (experience with at least most of these)
1. Experience with Big Data tools-Hadoop, Spark, Apache Beam, Kafka etc.
2. Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
3. Experience in ETL and Data Warehousing.
4. Experience and firm understanding of relational and non-relational databases like MySQL, MS SQL Server, Postgres, MongoDB, Cassandra etc.
5. Experience with cloud platforms like AWS, GCP and Azure.
6. Experience with workflow management using tools like Apache Airflow.
About Discite Analytics Private Limited
About
Discite Analytics & AI is a AI/ML and Data Engineering firm that specializes in creating custom solutions and products for companies of all sizes worldwide. Founded in 2020 by Kunal Singh, a former Uber executive, the company is committed to providing in-depth knowledge of their clients' business and operations to create the best solutions for SMEs.
At Discite Analytics & AI, we invest time interacting with end-users within our clients' companies, not just CXOs, to understand their data requirements fully. We offer a wide range of services, including conducting market research, setting up data pipelines, creating live dashboards, and building machine learning/artificial intelligence solutions to ensure our clients stay ahead of their competition with data-driven decision-making.
Connect with the team
Similar jobs
DATA ENGINEER
Overview
They started with a singular belief - what is beautiful cannot and should not be defined in marketing meetings. It's defined by the regular people like us, our sisters, our next-door neighbours, and the friends we make on the playground and in lecture halls. That's why we stand for people-proving everything we do. From the inception of a product idea to testing the final formulations before launch, our consumers are a part of each and every process. They guide and inspire us by sharing their stories with us. They tell us not only about the product they need and the skincare issues they face but also the tales of their struggles, dreams and triumphs. Skincare goes deeper than skin. It's a form of self-care for many. Wherever someone is on this journey, we want to cheer them on through the products we make, the content we create and the conversations we have. What we wish to build is more than a brand. We want to build a community that grows and glows together - cheering each other on, sharing knowledge, and ensuring people always have access to skincare that really works.
Job Description:
We are seeking a skilled and motivated Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining the data infrastructure and systems that enable efficient data collection, storage, processing, and analysis. You will collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to implement data pipelines and ensure the availability, reliability, and scalability of our data platform.
Responsibilities:
Design and implement scalable and robust data pipelines to collect, process, and store data from various sources.
Develop and maintain data warehouse and ETL (Extract, Transform, Load) processes for data integration and transformation.
Optimize and tune the performance of data systems to ensure efficient data processing and analysis.
Collaborate with data scientists and analysts to understand data requirements and implement solutions for data modeling and analysis.
Identify and resolve data quality issues, ensuring data accuracy, consistency, and completeness.
Implement and maintain data governance and security measures to protect sensitive data.
Monitor and troubleshoot data infrastructure, perform root cause analysis, and implement necessary fixes.
Stay up-to-date with emerging technologies and industry trends in data engineering and recommend their adoption when appropriate.
Qualifications:
Bachelor’s or higher degree in Computer Science, Information Systems, or a related field.
Proven experience as a Data Engineer or similar role, working with large-scale data processing and storage systems.
Strong programming skills in languages such as Python, Java, or Scala.
Experience with big data technologies and frameworks like Hadoop, Spark, or Kafka.
Proficiency in SQL and database management systems (e.g., MySQL, PostgreSQL, or Oracle).
Familiarity with cloud platforms like AWS, Azure, or GCP, and their data services (e.g., S3, Redshift, BigQuery).
Solid understanding of data modeling, data warehousing, and ETL principles.
Knowledge of data integration techniques and tools (e.g., Apache Nifi, Talend, or Informatica).
Strong problem-solving and analytical skills, with the ability to handle complex data challenges.
Excellent communication and collaboration skills to work effectively in a team environment.
Preferred Qualifications:
Advanced knowledge of distributed computing and parallel processing.
Experience with real-time data processing and streaming technologies (e.g., Apache Kafka, Apache Flink).
Familiarity with machine learning concepts and frameworks (e.g., TensorFlow, PyTorch).
Knowledge of containerization and orchestration technologies (e.g., Docker, Kubernetes).
Experience with data visualization and reporting tools (e.g., Tableau, Power BI).
Certification in relevant technologies or data engineering disciplines.
Hi All,
Greetings from LMV Group !!!
We are hiring for Policy Renewal Executive Domain for Insurance policy Renewal Calls , MIS,M.S.Office ,MSExcel,Handling Illustration
Experiance Required -0-3yrs
Intrested Candidates can directly apply
- Graduate+ in Mathematics, Statistics, Computer Science, Economics, Business, Engineering or equivalent work experience.
- Total experience of 5+ years with at least 2 years in managing data quality for high scale data platforms.
- Good knowledge of SQL querying.
- Strong skill in analysing data and uncovering patterns using SQL or Python.
- Excellent understanding of data warehouse/big data concepts such data extraction, data transformation, data loading (ETL process).
- Strong background in automation and building automated testing frameworks for data ingestion and transformation jobs.
- Experience in big data technologies a big plus.
- Experience in machine learning, especially in data quality applications a big plus.
- Experience in building data quality automation frameworks a big plus.
- Strong experience working with an Agile development team with rapid iterations.
- Very strong verbal and written communication, and presentation skills.
- Ability to quickly understand business rules.
- Ability to work well with others in a geographically distributed team.
- Keen observation skills to analyse data, highly detail oriented.
- Excellent judgment, critical-thinking, and decision-making skills; can balance attention to detail with swift execution.
- Able to identify stakeholders, build relationships, and influence others to get work done.
- Self-directed and self-motivated individual who takes complete ownership of the product and its outcome.
Candidates from Maharashtra will be preferred who will be ready to relocate to Mumbai.
Experience - 2+ yrs
Salary - depending on the experience and max upto 10 LPA
Immediate joiners preferable.
About Company :-
Our Client is the world's first fully insured cross - asset trading platform. Founded in 2020, this platform was created as a blockchain - based cryptocurrency exchange to bring significant and lasting change to financial markets. This ecosystem offers an all - in - one solution for digital assets ; made to trade, invest, and stake.
Key responsibilities :-
- Work closely with the leadership team to support the project
- Lead the strategy and execution for technology platforms, partnerships, and external platforms
- Design and set up the entire technology infrastructure
- Oversee all system design and changes
- Create and uphold security standards
- Track, analyze, and monitor the platform performance.
Job Location : Dubai
Requirements :-
- Experience in related role - game development, crypto, blockchain architecture
- Experience with Solidity , Rust, Truffle Suite
- Experience with leading teams
- Detail - oriented
- Hands - on approach to tactical problem solving
What you get :-
- Industry - commensurate pay
- Flexible working hours
- Highly skilled and motivated colleagues in the upcoming crypto capital of the world
About the Company
Blue Sky Analytics is a Climate Tech startup building an API based catalogue of Environmental Datasets by leveraging Satellite data, AI, and cloud. Our funders include Beenext and Rainmatter. Over the next 12 months, we aim to expand to 10 environmental datasets spanning water, land, heat, and more!
We are looking for a Sales Associate to be a part of the growing Sales and BD team and be a point of contact for self-sign-up users. Further, assist with non-consultative sales projects. Come save the planet with us!
Your Role
- Build extensive knowledge of our Developers Portal, datasets and APIs.
- Point of contact for our client's technical and logistical issues.
- Assist with off-the-shelf sales of our ready products.
- Maintain records of payments by users.
- Point of contact for self-onboarded users and their queries.
- Explore different softwares & tools that will aid customer experience.
- Collect meaningful feedback from clients and relay suggestions to the teams.
- Maintain and facilitate good relationships with clients.
- Collect meaningful feedback from clients and relay suggestions to the teams.
- Report to BD Lead and assist with sales funnel.
Requirements
- Good communication skills and by that, we also mean being an excellent listener is paramount.
- Technical background (Engineering, Data Science, Math, Physics, Computer Science) preferred.
- Organized and detail-oriented. Can keep track of multiple conversations and take each to a logical conclusion.
- Ability to simplify technical jargon for clients and effectively communicate the issue to the platform team.
- Aptitude for prioritizing tasks.
- Excellent problem-solving skills.
- Able to filter out which issue goes to which team.
- Ability to understand where the customer is coming from and be committed to client satisfaction.
- 1-2 Years Experience with B2B customer care preferred, but not required.
- Experience as a sales representative in Saas, DaaS.
- Experience with Hubspot and CRMs.
- Ability to pick up new tools. (Notion, Front etc)
- Experience in working with APIs and in data companies preferred.
Benefits
- Work from anywhere: Work by the beach or from the mountains.
- Open source at heart: We are building a community where you can use, contribute and collaborate on.
- Own a slice of the pie: Possibility of becoming an owner by investing in ESOPs.
- Flexible timings: Fit your work around your lifestyle.
- Comprehensive health cover: Health cover for you and your dependents to keep you tension free.
- Work Machine of choice: Buy a device and own it after completing a year at BSA.
- Quarterly Retreats: Yes there's work-but then there's all the non-work+fun aspect aka the retreat!
- Yearly vacations: Take time off to rest and get ready for the next big assignment by availing the paid leaves.
What if, you had a chance to build something iconic?
Presenting Bharat's first of its kind vernacular instant messaging app that is smart & secure - Buzz is an AI & machine learning powered - content-driven instant messaging app tailored to make user secure with more focus on privacy. At Buzz, we are on a mission - to help users be in control of the degree of their digital exposure, with a goal to create a space as India's first smart instant messaging platform among dominating foreign players.
And this is just the beginning :
With our eyes set on the future, we are looking for an exceptional iOS Developer with must have excellent experience in Socket.IO, to help us realise, build and scale our offering, who possesses a passion for technologies to the limits and will work with our team of talented engineers to design and build the next generation of our application.
iOS Beta already launched.
What you'll get :
Compensation in terms of EQUITY ONLY, salary only once we raise funds. This is more of a hands-on role especially in the initial stages of the company. Part-time would also temporarily work.
We are looking at passionate people with entrepreneurial spark and a hustler.
People who are deeply passionate of solving user problems in social networking space and vision of making an Indian product to be used by billions worldwide must only apply.
- A unique opportunity, unlike anything you have experienced before.
- Flexible timings & work from home
- A friend for life.
What matters to us : 1) Attitude > 2) Skill > 3) Experience > 4) College
Who are we looking for?
Key Responsibilities :
- Driving innovations in the product constantly to remain ahead of the curve.
- Serve as a thought leader and mentor on technical, architectural, design and related issues.
- Proactively identify architectural weaknesses and recommend appropriate solutions.
- Balance short-term versus long-term actions, strategic versus tactical requirements, while continuing to move forward towards the strategic vision.
- Provide functional, design, and code reviews in related areas of expertise with-in team and cross-team.
- Excellent technical issue diagnosis and problem-solving skills
Excellent knowledge of :
1) Node.js
2) Express.js
3) MongoDB
4) Restful APIs
5) Socket.IO
Skills required :
- MS or BS/B.Tech in computer science or equivalent experience from top college.
- Must have experience in working in an Instant messaging service provider.
- Experience working with remote data via REST and JSON
- Experience with offline storage, threading, and performance tuning
- Familiarity with cloud message APIs and push notifications
- Experience with third-party libraries and APIs
- Proficient understanding of code versioning tools, such as Git
- Excellent data structure & algorithm and problem-solving skills.
- Experience and knowledge of open source tools & frameworks, broader cutting edge technologies around server-side development.
- Should be an active contributor to developer communities like Stackoverflow, Topcoder, Github.
- Superior organization, communication, interpersonal and leadership skills.
- Must be a proven performer and team player that enjoy challenging assignments in a high-energy, fast-growing and start-up workplace.
- Must be a self-starter who can work well with minimal guidance and in fluid environment.
Looking for a go-getter, an ideal candidate with an entrepreneurial mindset, happy to wear multiple hats and jiggle between tasks.
Responsibilities:
- Day to day activities will include sales pitches, customer onboardings, Whatsapp Bot management, understanding customer pain points & devise quick hacks to resolve, be highly data-centric.
- Establish/Discover b2b strategic partnerships, carry out experiments, and do an analysis of conversions WoW, Customer acquisition cost, and so on.
- Definitely an interesting role to work on, opportunity to collaborate and learn multiple areas of operations and extensive knowledge capital.