Title:- Senior Data Engineer
Experience: 4-6 yrs
Budget: 24-28 lpa
Location: Bangalore
Work of Mode: Work from office
Primary Skills: Data Bricks, Spark, Pyspark,Sql, Python, AWS
Qualification: Any Engineering degree
Responsibilities:
∙Design and build reusable components, frameworks and libraries at scale to support analytics products.
∙Design and implement product features in collaboration with business and Technology
stakeholders.
∙Anticipate, identify and solve issues concerning data management to improve data quality.
∙Clean, prepare and optimize data at scale for ingestion and consumption.
∙Drive the implementation of new data management projects and re-structure of the current data architecture.
∙Implement complex automated workflows and routines using workflow scheduling tools.
∙Build continuous integration, test-driven development and production deployment
frameworks.
∙Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards.
∙Analyze and profile data for the purpose of designing scalable solutions.
∙Troubleshoot complex data issues and perform root cause analysis to proactively resolve
product and operational issues.
∙Mentor and develop other data engineers in adopting best practices.
Qualifications:
Primary skillset:
∙Experience working with distributed technology tools for developing Batch and Streaming pipelines using
o SQL, Spark, Python, PySpark [4+ years],
o Airflow [3+ years],
o Scala [2+ years].
∙Able to write code which is optimized for performance.
∙Experience in Cloud platform, e.g., AWS, GCP, Azure, etc.
∙Able to quickly pick up new programming languages, technologies, and frameworks.
∙Strong skills building positive relationships across Product and Engineering.
∙Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders
∙Experience with creating/ configuring Jenkins pipeline for smooth CI/CD process for Managed Spark jobs, build Docker images, etc.
∙Working knowledge of Data warehousing, Data modelling, Governance and Data Architecture
Good to have:
∙Experience working with Data platforms, including EMR, Airflow, Databricks (Data
Engineering & Delta Lake components, and Lakehouse Medallion architecture), etc.
∙Experience working in Agile and Scrum development process.
∙Experience in EMR/ EC2, Databricks etc.
∙Experience working with Data warehousing tools, including SQL database, Presto, and
Snowflake
∙Experience architecting data product in Streaming, Serverless and Microservices Architecture and platform.
About Arting Digital
Similar jobs
Introduction
Designation - Product Manager
We are seeking an experienced and innovative Product Manager to join our dynamic team at Better Analytics Pvt Ltd (Scremer). The ideal candidate will play a pivotal role in driving the evolution of Scremer, ensuring a seamless user experience, and spearheading the development of new features to enhance user engagement and satisfaction.
Roles and Responsibilities
- Should be able to create a product roadmap and product strategy
- Should be able to do product discovery, product validation, and product analytics.
- Should be able to run the sprints and daily scrum calls.
- Should have managed products/ features around workflow management or business process mapping.
- Develop and execute a comprehensive product strategy aligned with Scremer's mission, considering user feedback, market trends, and business objectives.
- Lead the end-to-end product development lifecycle, from ideation to implementation. Collaborate with cross-functional teams to introduce new features and enhancements that elevate the user experience.
- Continuously analyze user interactions and feedback to identify areas for improvement. Implement strategies to optimize user experience and satisfaction.
- Utilize data analytics to make informed product decisions. Monitor key performance indicators (KPIs) and user behavior to guide feature prioritization and enhancements.
- Collaborate with marketing, development, and customer support teams to ensure seamless integration of product initiatives. Communicate product updates, features, and improvements to internal and external stakeholders.
- Stay informed about industry trends, competitive products, and user needs. Conduct market research to identify opportunities for innovation and differentiation.
Must Have Skills
- Minimum 3 years of experience as a Product Manager.
- Must be able to create new products from scratch using Lean Product Methodology.
- Must be able to do Customer Development and find PMF for new products.
- Must be able to use Google Suite, Microsoft Suite, and Adobe Suite with ease.
- Must be able to write specifications and create wireframes on demand.
- Must be able to create a product strategy and product roadmap.
- Must have experience working with at least one wireframing tool, like Balsamiq or Whimsical, Azure XP, or any others.
- Must have hands-on experience with agile product management tools like JIRA, Clickup or any other tool.
- Must have excellent communication, articulation, and presentation skills.
- Must be able to understand business models and create business model canvas with ease.
- Must be able to do A/B testing to test new product ideas.
Good to Have Skills
- Preference will be given to candidates who have experience working in startups.
- If you have already worked in a marketplace product or a platform product you would be given preference over other candidates.
- System Design Skills and any understanding of technology will be a great advantage.
- Ability to work with AARRR metrics - both for the producers and consumers in the marketplace.
About Scremer
Better Analytics Pvt Ltd, the creator of Scremer, is a pioneering social feedback platform that empowers users to voice their complaints and concerns. Scremer provides a space for users to share their experiences regarding various issues, from poor customer service and faulty products to unjust policies. The platform encourages community support through a unique feature called scream up, where users can rally behind each other's complaints. The most impactful grievances are prominently featured on the homepage, fostering a transparent and engaging user environment.
Location
Address: Durgam Cheruvu Rd, Kavuri Hills, Madhapur, Hyderabad, Gafoornagar, Telangana 500081.
Hyderabad - Scremer was Founded in 2021, Situated in the vibrant area of Kavuri Hills, Hyderabad, this address on Durgam Cheruvu Rd embodies a blend of urban convenience and natural beauty. It is located in Gafoornagar and offers a prime location with easy access to amenities and the picturesque Durgam Cheruvu.
Why Join Scremer?
- Innovative Mission: Join Scremer at Better Analytics Pvt Ltd to be part of an innovative social feedback platform that gives users a powerful voice.
- Engaging User-Centric Environment: Work in a dynamic and user-centric environment where every complaint matters. At Scremer, users can connect, support each other through "scream up," and influence positive change.
- Transparent and Impactful Platform: Join a company that believes in transparency and impact. Scremer features the most popular complaints on its homepage, providing users with visibility into real issues.
- Professional Growth Opportunities: At Scremer, we value talent and commitment. Join a company that fosters professional growth and skill development. Be part of a team that encourages innovation, collaboration, and continuous improvement, offering you a platform to excel in your career.
JOB DETAILS
CTC - 12-15 LPA
EXP RANGE - 3-5 Years
Education - Any Degree
Notice Period - 15-30 Days.
Work Mode - WFO
Location - Hyderabad
About OJ Commerce:
OJ Commerce is a fast-growing, profitable online retailer based in Florida, USA with a full-fledged India office based in Chennai driven by a sophisticated, data-driven system to run the operations with virtually no human intervention. We strive to be the best-in-class ecommerce company delivering exceptional value to customers by leveraging technology, innovation and brand-partnerships to provide a seamless & enjoyable shopping of high-quality products at the best prices. Role: Individual Contributor Role.
Skill Sets:
• Exposure to data modelling and ability to develop complex queries & procedures
• Manage and monitor performance, capacity and security of the database
• Continuously improve the performance of the database in alliance with the Database Adminstrator by optimizing jobs, procedures & queries
Desirable Skills:
➢ Candidates with experience in ecommerce / online retail is added value.
➢ Communication Skills – Excellent verbal and written communication skills with ability to explain ideas very clearly.
➢ Self–motivated and flexible, with an ability to work independently.
- Good Accountant
- Purchase bill booking
- Sale bill booking
- Petty Cash Accounting
- Gate entry systems
- Good Accountant
👋🏼We're Nagarro.
We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital , and our people exist everywhere in the world (19000+ experts across 33 countries, to be exact). Our work culture is dynamic and non-hierarchical. We're looking for great new colleagues. That's where you come in.
REQUIREMENTS:
- Must-Have: Typescript
- Expertise in TypeScript, HTML CSS, React JS, Unit Testing, Webpack, Service Worker and Web Worker
- Knowledge of high-quality professional software engineering practices for the agile software development cycle, including coding standards, code reviews, source control management, build processes, testing, and deployment
- Fundamental knowledge of design patterns
- Passionate about building great solutions
- Mentoring the team members to meet the client's needs and holding them accountable for high standards of delivery
- Knowledge of multi-site and multi-locale sites would be preferred
- Task delivery, Task status reporting, Proactive Contribution, Process Adherence, Autonomous task delivery, Effort estimation (Strong), Technical risk handling, Technical solutions (Strong), Risk management (Strong), Technical leadership (Capable), Client interaction, Interviewer, Pre-sales support.
- Knowledge of high-quality professional software engineering practices for the agile software development cycle, including coding standards, code reviews, source control management, build processes, testing, and deployment
- Fundamental knowledge of design patterns
- Experience in communicating effectively with users, other technical teams, and management to collect requirements, describe software product features, and technical designs
- Passionate about building great solutions
- Mentoring the team members to meet the client's needs and holding them accountable for high standards of delivery
- Being able to understand and relate technology integration scenarios and be able to apply these learnings in complex troubleshooting scenarios
RESPONSIBILITIES:
- Writing and reviewing great-quality code
- Understanding functional requirements thoroughly and analyzing the client’s needs in the context of the project
- Envisioning the overall solution for defined functional and non-functional requirements, and being able to define technologies, patterns and frameworks to realize it
- Determining and implementing design methodologies and toolsets
- Enabling application development by coordinating requirements, schedules, and activities.
- Being able to lead/support UAT and production rollouts
- Creating, understanding and validating WBS and estimated effort for a given module/task, and being able to justify it
- Addressing issues promptly, responding positively to setbacks and challenges with a mindset of continuous improvement
- Giving constructive feedback to the team members and setting clear expectations.
- Helping the team in troubleshooting and resolving complex bugs
- Coming up with solutions to any issue that is raised during code/design review and being able to justify the decision taken
- Carrying out POCs to make sure that suggested designs/technologies meet the requirements
Roles and Responsibilities :
- Handling inquiries to get quotations from the vendor and closing it by generating the purchase orders.
- Coordinating and negotiating with vendors to get the most cost effective quotations.
- Procure products at negotiated rates from vendors
- Researching new prospective brands and affitating with them for new business
- Establish and maintain relationships with industry influencers and key strategic partners
- Preparing proposals for the clients based on their respective inquiries. Utilizing excel to keep the dashboard off inquiries, quotation, purchase orders, payments & deliveries.
Key Skills required
- Excellent communication, presentation and leadership skills
- Sound knowledge of MS - Office
- Outstanding organizational and time management skills
- Aptitude in presentation and public speaking
- Attention to details Critical thinker and analytical problem solver
- Partnering with internal business owners (product, marketing, edit, etc.) to understand needs and develop custom analysis to optimize for user engagement and retention
- Good understanding of the underlying business and workings of cross functional teams for successful execution
- Design and develop analyses based on business requirement needs and challenges.
- Leveraging statistical analysis on consumer research and data mining projects, including segmentation, clustering, factor analysis, multivariate regression, predictive modeling, etc.
- Providing statistical analysis on custom research projects and consult on A/B testing and other statistical analysis as needed. Other reports and custom analysis as required.
- Identify and use appropriate investigative and analytical technologies to interpret and verify results.
- Apply and learn a wide variety of tools and languages to achieve results
- Use best practices to develop statistical and/ or machine learning techniques to build models that address business needs.
Requirements
- 2 - 4 years of relevant experience in Data science.
- Preferred education: Bachelor's degree in a technical field or equivalent experience.
- Experience in advanced analytics, model building, statistical modeling, optimization, and machine learning algorithms.
- Machine Learning Algorithms: Crystal clear understanding, coding, implementation, error analysis, model tuning knowledge on Linear Regression, Logistic Regression, SVM, shallow Neural Networks, clustering, Decision Trees, Random forest, XGBoost, Recommender Systems, ARIMA and Anomaly Detection. Feature selection, hyper parameters tuning, model selection and error analysis, boosting and ensemble methods.
- Strong with programming languages like Python and data processing using SQL or equivalent and ability to experiment with newer open source tools.
- Experience in normalizing data to ensure it is homogeneous and consistently formatted to enable sorting, query and analysis.
- Experience designing, developing, implementing and maintaining a database and programs to manage data analysis efforts.
- Experience with big data and cloud computing viz. Spark, Hadoop (MapReduce, PIG, HIVE).
- Experience in risk and credit score domains preferred.
Job Description
A business development executive will be responsible for researching and pursuing new business leads for the growth of the business. The role involves active coordination across teams and demands exceptional interpersonal skills. The executive is expected to work on new business proposals which are a persuasive representation of an organization's services.
Responsibilities/Requirements
- Must have knowledge of online bidding for IT Projects (Bidding Tools: Freelancer, Upwork, Fiver, etc.)
- Proper knowledge of proposal writing.
- Candidates should have experience with client communication, Follow ups and Negotiation.
- Project Management experience will be a plus.
- Should have IT Background experience.
Key Skills
Bidding on Freelancer / Upwork / Fiverr, Proposal Making, Negotiation, Client Communication, Project Management
- Hands on experience in following is a must: Unix, Python and Shell Scripting.
- Hands on experience in creating infrastructure on cloud platform AWS is a must.
- Must have experience in industry standard CI/CD tools like Git/BitBucket, Jenkins, Maven, Artifactory and Chef.
- Must be good at these DevOps tools:
Version Control Tools: Git, CVS
Build Tools: Maven and Gradle
CI Tools: Jenkins
- Hands-on experience with Analytics tools, ELK stack.
- Knowledge of Java will be an advantage.
- Experience designing and implementing an effective and efficient CI/CD flow that gets code from dev to prod with high quality and minimal manual effort.
- Ability to help debug and optimise code and automate routine tasks.
- Should be extremely good in communication
- Experience in dealing with difficult situations and making decisions with a sense of urgency.
- Experience in Agile and Jira will be an add on