- 3+ years of industry experience in administering (including setting up, managing, monitoring) data processing pipelines (both streaming and batch) using frameworks such as Kafka, ELK Stack, Fluentd and streaming databases like druid
- Strong industry expertise with containerization technologies including kubernetes, docker-compose
- 2+ years of industry in experience in developing scalable data ingestion processes and ETLs
- Experience with cloud platform services such as AWS, Azure or GCP especially with EKS, Managed Kafka
- Experience with scripting languages. Python experience highly desirable.
- 2+ Industry experience in python
- Experience with popular modern web frameworks such as Spring boot, Play framework, or Django
- Demonstrated expertise of building cloud native applications
- Experience in administering (including setting up, managing, monitoring) data processing pipelines (both streaming and batch) using frameworks such as Kafka, ELK Stack, Fluentd
- Experience in API development using Swagger
- Strong expertise with containerization technologies including kubernetes, docker-compose
- Experience with cloud platform services such as AWS, Azure or GCP.
- Implementing automated testing platforms and unit tests
- Proficient understanding of code versioning tools, such as Git
- Familiarity with continuous integration, Jenkins
- Design and Implement Large scale data processing pipelines using Kafka, Fluentd and Druid
- Assist in dev ops operations
- Develop data ingestion processes and ETLs
- Design and Implement APIs
- Assist in dev ops operations
- Identify performance bottlenecks and bugs, and devise solutions to these problems
- Help maintain code quality, organization, and documentation
- Communicate with stakeholders regarding various aspects of solution.
- Mentor team members on best practices
Similar jobs
o You’re both relentless and kind, and don’t see these as being mutually
exclusive
o You have a self-directed learning style, an insatiable curiosity, and a
hands-on execution mindset
o You have deep experience working with product and engineering teams
to launch machine learning products that users love in new or rapidly
evolving markets
o You flourish in uncertain environments and can turn incomplete,
conflicting, or ambiguous inputs into solid data-science action plans
o You bring best practices to feature engineering, model development, and
ML operations
o Your experience in deploying and monitoring the performance of models
in production enables us to implement a best-in-class solution
o You have exceptional writing and speaking skills with a talent for
articulating how data science can be applied to solve customer problems
Must-Have Qualifications
o Graduate degree in engineering, data science, mathematics, physics, or
another quantitative field
o 5+ years of hands-on experience in building and deploying production-
grade ML models with ML frameworks (TensorFlow, Keras, PyTorch) and
libraries like scikit-learn
o Track-record in building ML pipelines for time series, classification, and
predictive applications
o Expert level skills in Python for data analysis and visualization, hypothesis
testing, and model building
o Deep experience with ensemble ML approaches including random forests
and xgboost, and experience with databases and querying models for
structured and unstructured data
o A knack for using data visualization and analysis tools to tell a story
o You naturally think quantitatively about problems and work backward
from a customer outcome
What’ll make you stand out (but not required)
o You have a keen awareness or interest in network analysis/graph analysis
or NLP
o You have experience in distributed systems and graph databases
o You have a strong connection to finance teams or closely related
domains, the challenges they face, and a deep appreciation for their
aspirations
Data Analyst
Job Description
Summary
Are you passionate about handling large & complex data problems, want to make an impact and have the desire to work on ground-breaking big data technologies? Then we are looking for you.
At Amagi, great ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish. Would you like to work in a fast-paced environment where your technical abilities will be challenged on a day-to-day basis? If so, Amagi’s Data Engineering and Business Intelligence team is looking for passionate, detail-oriented, technical savvy, energetic team members who like to think outside the box.
Amagi’s Data warehouse team deals with petabytes of data catering to a wide variety of real-time, near real-time and batch analytical solutions. These solutions are an integral part of business functions such as Sales/Revenue, Operations, Finance, Marketing and Engineering, enabling critical business decisions. Designing, developing, scaling and running these big data technologies using native technologies of AWS and GCP are a core part of our daily job.
Key Qualifications
- Experience in building highly cost optimised data analytics solutions
- Experience in designing and building dimensional data models to improve accessibility, efficiency and quality of data
- Experience (hands on) in building high quality ETL applications, data pipelines and analytics solutions ensuring data privacy and regulatory compliance.
- Experience in working with AWS or GCP
- Experience with relational and NoSQL databases
- Experience to full stack web development (Preferably Python)
- Expertise with data visualisation systems such as Tableau and Quick Sight
- Proficiency in writing advanced SQL queries with expertise in performance tuning handling large data volumes
- Familiarity with ML/AÍ technologies is a plus
- Demonstrate strong understanding of development processes and agile methodologies
- Strong analytical and communication skills. Should be self-driven, highly motivated and ability to learn quickly
Description
Data Analytics is at the core of our work, and you will have the opportunity to:
- Design Data-warehousing solutions on Amazon S3 with Athena, Redshift, GCP Bigtable etc
- Lead quick prototypes by integrating data from multiple sources
- Do advanced Business Analytics through ad-hoc SQL queries
- Work on Sales Finance reporting solutions using tableau, HTML5, React applications
We build amazing experiences and create depth in knowledge for our internal teams and our leadership. Our team is a friendly bunch of people that help each other grow and have a passion for technology, R&D, modern tools and data science.
Our work relies on deep understanding of the company needs and an ability to go through vast amounts of internal data such as sales, KPIs, forecasts, Inventory etc. One of the key expectations of this role would be to do data analytics, building data lakes, end to end reporting solutions etc. If you have a passion for cost optimised analytics and data engineering and are eager to learn advanced data analytics at a large scale, this might just be the job for you..
Education & Experience
A bachelor’s/master’s degree in Computer Science with 5 to 7 years of experience and previous experience in data engineering is a plus.
GIS Analyst/GIS Data Analyst
Energy Exemplar is the market leader in Energy Modelling & Simulation Products. Energy Exemplar customers across the globe are modelling their energy markets with confidence to make billion-dollar decisions
Job Overview for GIS Data Analyst
You should be a self-starter with high motivation and will be a core member of the Energy Data team. You will be responsible for developing the company’s competence in geographic energy data collection, maintenance, and delivery to customers through our extensive suite of SaaS products. Our products support companies engaged in power and natural gas markets on 6 continents. Our customers are industry leaders in supply, transportation, delivery, operations and trading and our products allow our customers to deliver their optimal solution. Our data are sourced from hundreds of websites in many languages and your job is to ensure that we have the geographic reference to make sense of the data. You will use your creativity, pattern recognition skills, satellite and aerial imagery and other public sources to provide geographic reference data across the energy industry. You will work with the Energy Data Analysts to teach them basic GIS research capabilities. Learnings out of this role will build foundation of skills necessary to advance to roles such as Energy Market Analyst or Data Scientist.
Education & Experience
- Master’s/Post Graduate Diploma degree in Geoinformatics/GIS, Geoinformatics & Natural Resources Engineering, Remote sensing & GIS, GIS/Spatial Data Science with Bachelors/Masters in Energy/Energy Management /Electrical Engg/Power System/Oil and Gas Management/Petroleum/Geophysics & Other Energy Industry related degrees would be preferred OR
Master’s/Post Graduate Diploma degree/Bachelor’s in Geoinformatics/GIS, Geoinformatics & Natural Resources Engineering, Remote sensing & GIS, GIS/Spatial Data Science, or any engineering streams
- 2+ years of experience working with GIS Systems/Database, GIS data management / GIS data handling and processing/GIS data engineering
Essential/Necessary Skills
- Proficiency in handling GIS data with SQL, Python/R
- Exposure to mapping tools QGIS/ARCGIS/Visio/FME
- Expertise in spatial modelling and geospatial analytics (Raster/Vector tools)
- Proven experience working with geospatial data integration and testing
- Outstanding communication and collaboration skills.
- Strong drive for results. You have a proven record of shepherding experiments to create successful shipping products/services.
About Energy Exemplar
Energy Exemplar is the global market leader in the technology of optimization-based energy market simulation. Our software suite, headlined by PLEXOS and Aurora, is used across every region of the world for a wide range of applications, from short-term analysis to long-term planning studies. Driven by the frenetic pace of advancements in computing technology and mathematical algorithms, our people continually think of novel approaches and more realistic simulations that enhance decision making, create market opportunities that benefit us all and enable utilities and regulatory authorities to become smarter, more energy efficient and profitable. Energy Exemplar continues to ‘push the envelope’, being first-to-market with the latest advances in mathematical programming and energy market simulation theory, as it strives to offer the most comprehensive simulation software to its customer base. Development continues to be headquartered in Adelaide, South Australia, led by Glenn Drayton and backed by a team with expertise in software development, operations research, economics, mathematics, statistics, and electrical engineering.
For more details, please visit http://www.energyexemplar.com
We are looking out for a technically driven "Full-Stack Engineer" for one of our premium client
COMPANY DESCRIPTION:
Qualifications
• Bachelor's degree in computer science or related field; Master's degree is a plus
• 3+ years of relevant work experience
• Meaningful experience with at least two of the following technologies: Python, Scala, Java
• Strong proven experience on distributed processing frameworks (Spark, Hadoop, EMR) and SQL is very
much expected
• Commercial client-facing project experience is helpful, including working in close-knit teams
• Ability to work across structured, semi-structured, and unstructured data, extracting information and
identifying linkages across disparate data sets
• Confirmed ability in clearly communicating complex solutions
• Understandings on Information Security principles to ensure compliant handling and management of
client data
• Experience and interest in Cloud platforms such as: AWS, Azure, Google Platform or Databricks
• Extraordinary attention to detail
Fresher Data Engineer- Python+SQL (Internship+Job Opportunity)
Location - Remote till covid ( Hyderabad Stacknexus office post covid)
Experience - 5 - 7 years
Skills Required - Should have hands-on experience in Azure Data Modelling, Python, SQL and Azure Data bricks.
Notice period - Immediate to 15 days
Backend Engineer
- Experience with relational SQL & NoSQL databases including MySQL & MongoDB.
- Familiar with the basic principles of distributed computing and data modeling.
- Experience with distributed data pipeline frameworks like Celery, Apache Airflow, etc.
- Experience with NLP and NER models is a bonus.
- Experience building reusable code and libraries for future use.
- Experience building REST APIs.
Preference for candidates working in tech product companies
Data Science - Architect
at AI-driven platform designed for education,e-commerce sectors
The Job
The Architect, Machine Learning and Artificial Intelligence including Computer Vision will grow and lead a team of talented Machine Learning (ML), Computer Vision (CV) and Artificial Intelligence (AI) researchers and engineers to develop innovative machine learning algorithms, scalable ML system, and AI applications for Racetrack. This role will be focused on developing and deploying personalization and recommender system, search, experimentation, audience, and content AI solutions to drive user experience and growth.
The Daily
- Develop innovative data science solutions that utilize machine learning and deep learning algorithms, statistical and quantitative modelling approaches to support product, engineering, content, and marketing initiatives.
- Build and lead a world-class team of ML and AI scientists and engineers.
- Be a hands-on leader to mentor the team in latest machine learning and deep learning approaches, and to introduce new technologies and processes. Single headedly manage the MVP and PoCs
- Work with ML engineers to design solution architecture and develop scalable machine learning system to accelerate learning cycle.
- Identify data science opportunities that deliver business value.
- Develop ML/AI/CV roadmap and educate both internal and external stakeholders at all levels to drive implementation and measurement.
- Hands on experience in Image processing for auto industry
- BFSI domain knowledge is a plus
- Provide thought leadership to enable ML/AI applications.
- Manage products priorities and ensure timely delivery.
- Develop and evangelize best practices for scoping, building, validating, deploying, and monitoring ML/AI products.
- Prepare and present ML modelling results and analytical insights that help drive the business to senior leadership.
The Essentials
- 8 + years of work experience in Machine Learning, AI and Data Science with a proven track record to drive innovation and business impacts
- 4 + years of managing a team of data scientists, ML and AI researchers and engineers
- Strong machine learning, deep learning, and statistical modelling expertise, such as causal inference modelling, ensembles, neural networks, reinforcement learning, NLP, and computer vision
- Advanced knowledge of SQL and experience with big data platform (AWS, Snowflake, Spark, Google Cloud etc.)
- Proficiency in machine learning and deep learning languages and platforms (Python, R, TensorFlow, Keras, PyTorch, MXNet etc.)
- Experience in deploying machine learning algorithms and advanced modelling solutions
- Experience in developing advanced analytics and ML infrastructure and system
- Self-starter and self-motivated with the proven ability to deliver results in a fast-paced, high-energy environment
- Strong communication skills and the ability to explain complex analysis and algorithms to non-technical audience
- Works effectively cross functional teams to build trusted partnership
- Working experience in digital media and entertainment industry preferred
- Experience with Agile methodologies preferred
