Data Engineer

5-7 years of experience in Data Engineering with solid experience in design, development and implementation of end-to-end data ingestion and data processing system in AWS platform.

2-3 years of experience in AWS Glue, Lambda, Appflow, EventBridge, Python, PySpark, Lake House, S3, Redshift, Postgres, API Gateway, CloudFormation, Kinesis, Athena, KMS, IAM.

Experience in modern data architecture, Lake House, Enterprise Data Lake, Data Warehouse, API interfaces, solution patterns, standards and optimizing data ingestion.

Experience in build of data pipelines from source systems like SAP Concur, Veeva Vault, Azure Cost, various social media platforms or similar source systems.

Expertise in analyzing source data and designing a robust and scalable data ingestion framework and pipelines adhering to client Enterprise Data Architecture guidelines.

Proficient in design and development of solutions for real-time (or near real time) stream data processing as well as batch processing on the AWS platform.

Work closely with business analysts, data architects, data engineers, and data analysts to ensure that the data ingestion solutions meet the needs of the business.

Troubleshoot and provide support for issues related to data quality and data ingestion solutions. This may involve debugging data pipeline processes, optimizing queries, or troubleshooting application performance issues.

Experience in working in Agile/Scrum methodologies, CI/CD tools and practices, coding standards, code reviews, source management (GITHUB), JIRA, JIRA Xray and Confluence.

Experience or exposure to design and development using Full Stack tools.

Strong analytical and problem-solving skills, excellent communication (written and oral), and interpersonal skills.

Bachelor's or master's degree in computer science or related field.

Lightning job by Cutshort ⚡

As part of this feature, you can expect status updates about your application and replies within 72 hours (once the screening questions are answered)

About Us:

Virtualness is the first end-to-end decentralized web3 platform offering mobile-first generative AI creation, NFT minting, and marketplace tools in one place making it easy for any creator or brand to scale their business and easily capture the value-creation opportunity that blockchain presents. Built on the ethos of ’empathy at the core' Virtualness puts creators first, and is building the playbook for AI led

easy design, efficient sharing / social experiences and seamless digital commerce.

Job Description:

We are seeking a highly motivated and detail-oriented Data Analyst to join our team. The ideal candidate will possess strong analytical skills, proficiency in data manipulation and visualization tools, and a passion for deriving actionable insights from complex datasets. The Data Analyst will play a key role in interpreting data, identifying trends, and providing valuable recommendations to support strategic business objectives.

Key Responsibilities:

- Analyze large datasets to extract meaningful patterns, trends, and insights.

- Develop and maintain data models, dashboards, and reports to track key performance indicators (KPIs) and inform decision-making processes.

- Collaborate with cross-functional teams to understand business requirements and translate them into data-driven solutions.

- Perform data cleansing, transformation, and validation to ensure accuracy and consistency of data.

- Conduct ad-hoc analyses to address specific business questions and provide actionable recommendations.

- Utilize statistical techniques and predictive modeling to identify opportunities for process optimization and revenue enhancement.

- Stay updated on industry trends, best practices, and emerging technologies in data analytics and contribute to continuous improvement initiatives.

- Present findings and insights to stakeholders in a clear and compelling manner through written reports and presentations.

Qualifications:

- Bachelor's degree in Statistics, Mathematics, Computer Science, Economics, or related field; Master's degree preferred.

- Proven experience as a Data Analyst or similar role, with a track record of delivering actionable insights and driving business impact.

- Proficiency in SQL, Python, R, or other programming languages for data analysis and manipulation.

- Strong analytical skills with the ability to work with large datasets and complex data structures.

- Experience with data visualization tools such as Tableau, Power BI, or Looker.

- Familiarity with statistical techniques, machine learning algorithms, and data mining methods.

- Excellent communication and presentation skills, with the ability to convey technical concepts to non-technical stakeholders.

- Strong attention to detail and problem-solving abilities.

- Ability to work effectively both independently and as part of a team in a fast-paced environment.

Preferred Qualifications: 

- Experience with cloud-based platforms such as AWS, Google Cloud Platform, or Azure.

- Knowledge of advanced analytics techniques such as predictive modeling, clustering, and segmentation.

- Previous experience in the Web3 industry is a plus.

Benefits:

- Competitive salary

- Health insurance

- Flexible work hours

- ESOPS

- Opportunities for professional growth

- Access to cutting-edge technologies

- A collaborative and innovative work environment

Lightning Job By Cutshort ⚡

As part of this feature, you can expect status updates about your application and replies within 72 hours (once the screening questions are answered)

About Databook:-

- Great salespeople let their customers’ strategies do the talking.

Databook’s award-winning Strategic Relationship Management (SRM) platform uses advanced AI and NLP to empower the world’s largest B2B sales teams to create, manage, and maintain strategic relationships at scale. The platform ingests and interprets billions of financial and market data signals to generate actionable sales strategies that connect the seller’s solutions to a buyer’s financial pain and urgency.

The Opportunity

We're seeking Junior Engineers to support and develop Databook’s capabilities. Working closely with our seasoned engineers, you'll contribute to crafting new features and ensuring our platform's reliability. If you're eager about playing a part in building the future of customer intelligence, with a keen eye towards quality, we'd love to meet you!

Specifically, you'll

- Participate in various stages of the engineering lifecycle alongside our experienced engineers.

- Assist in maintaining and enhancing features of the Databook platform.

- Collaborate with various teams to comprehend requirements and aid in implementing technology solutions.

Please note: As you progress and grow with us, you might be introduced to on-call rotations to handle any platform challenges.

Working Arrangements:

- This position offers a hybrid work mode, allowing employees to work both remotely and in-office as mutually agreed upon.

What we're looking for

- 1-2+ years experience as a Data Engineer

- Bachelor's degree in Engineering

- Willingness to work across different time zones

- Ability to work independently

- Knowledge of cloud (AWS or Azure)

- Exposure to distributed systems such as Spark, Flink or Kafka

- Fundamental knowledge of data modeling and optimizations

- Minimum of one year of experience using Python working as a Software Engineer

- Knowledge of SQL (Postgres) databases would be beneficial

- Experience with building analytics dashboard

- Familiarity with RESTful APIs and/or GraphQL is welcomed

- Hand-on experience with Numpy, Pandas, SpaCY would be a plus

- Exposure or working experience on GenAI (LLMs in general), LLMOps would be a plus

- Highly fluent in both spoken and written English language

Ideal candidates will also have:

- Self-motivated with great organizational skills.

- Ability to focus on small and subtle details.

- Are willing to learn and adapt in a rapidly changing environment.

- Excellent written and oral communication skills.

Join us and enjoy these perks!

- Competitive salary with bonus

- Medical insurance coverage

- 5 weeks leave plus public holidays

- Employee referral bonus program

- Annual learning stipend to spend on books, courses or other training materials that help you develop skills relevant to your role or professional development

- Complimentary subscription to Masterclass

Our client is the world’s largest media investment company and are a part of WPP. In fact, they are responsible for one in every three ads you see globally. We are currently looking for a Senior Software Engineer to join us. In this role, you will be responsible for coding/implementing of custom marketing applications that Tech COE builds for its customer and managing a small team of developers.

What your day job looks like:

• Serve as a Subject Matter Expert on data usage – extraction, manipulation, and inputs for analytics
• Develop data extraction and manipulation code based on business rules
• Develop automated and manual test cases for the code written
• Design and construct data store and procedures for their maintenance
• Perform data extract, transform, and load activities from several data sources.
• Develop and maintain strong relationships with stakeholders
• Write high quality code as per prescribed standards.
• Participate in internal projects as required

 
Minimum qualifications:

• B. Tech./MCA or equivalent preferred
• Excellent 3 years Hand on experience on Big data, ETL Development, Data Processing.

    What you’ll bring:

• Strong experience in working with Snowflake, SQL, PHP/Python.
• Strong Experience in writing complex SQLs
• Good Communication skills
• Good experience of working with any BI tool like Tableau, Power BI.
• Sqoop, Spark, EMR, Hadoop/Hive are good to have.

• At least 4 to 7 years of relevant experience as Big Data Engineer
• Hands-on experience in Scala or Python
• Hands-on experience on major components in Hadoop Ecosystem like HDFS, Map Reduce, Hive, Impala.
• Strong programming experience in building applications/platform using Scala or Python.
• Experienced in implementing Spark RDD Transformations, actions to implement business analysis

• We are looking for : Data engineer
• Sprak
• Scala
• Hadoop