Data Engineering Resources

Exploring Network Flow Algorithms: Efficiently Channeling Information

This article delves into the world of network flow algorithms, exploring their key concepts, applications, and notable algorithms.

October 17, 2023

by Aditya Bhuyan

· 2,360 Views · 3 Likes

Mastering Backpressure in Java: Concepts, Real-World Examples, and Implementation

Backpressure balances data production and consumption, preventing system overload. Java's Flow API enables effective backpressure implementation in applications.

October 17, 2023

by Arun Pandey

· 5,691 Views · 7 Likes

The 3 Stages of an Effective Test Data Strategy

Testing is crucial for delivering quality applications quickly, but providing the right test data remains a major bottleneck.

October 17, 2023

by Rich Jordan

· 2,820 Views · 1 Like

Kafka Event Streaming AI and Automation

Explore how to use ChatGPT to create an IoT Kafka event consumer and API Logic Server to logic to produce temperature reading events outside a defined range.

October 17, 2023

by Tyler Band

· 4,980 Views · 5 Likes

Enhanced Security for Your Secrets With AWS Secrets Manager

AWS Secrets Manager secures credentials with encryption and access controls while providing robust protection against threats.

October 17, 2023

by Raghava Dittakavi

· 3,519 Views · 2 Likes

Future Trends in Data Integration

Exploring the future of data integration, from cloud solutions and real-time analytics to machine learning. Adaptability is key in this evolving landscape.

October 17, 2023

by Jeffrey Faber

· 2,720 Views · 3 Likes

SQL Data Manipulation Language (DML) Operations: Insert, Update, Delete

This article covers SQL DML operations like insert, update, delete, and more, including drop, distinct, and group by.

October 17, 2023

by Madhuri Hammad

· 3,241 Views · 3 Likes

The Impact of IoT on Data Integration: A Transformational Journey

IoT's impact on data integration is profound, driving shifts in storage methods, real-time processing, and architectural paradigms.

October 17, 2023

by Ralph Burgess

· 2,624 Views · 1 Like

Fine Tuning LLM: Parameter Efficient Fine Tuning (PEFT), LoRA and QLoRA: Part 1

In this blog, we will understand the idea behind Parameter Efficient Fine Tuning (PEFT) and explore LoRA and QLoRA, Two of the most important PEFT methods.

October 16, 2023

by A B Vijay Kumar

· 2,581 Views · 2 Likes

Oracle Outlines Vision for AI and Cloud-Driven Future

Larry Ellison believes generative AI is transformational and details the unique advantages of Oracle Cloud for building enterprise AI apps

October 16, 2023

by Tom Smith CORE

· 2,831 Views · 2 Likes

A Deep Dive Into the Call Chain Relationship Between Presto, Hive, and Alluxio

Understanding how Presto+Hive+Alluxio work together and the flow from SQL query to low-level file system operations is key to tuning performance.

October 16, 2023

by Jiaming Mai

· 2,430 Views · 1 Like

How Is Apache APISIX Fast?

Apache APISIX achieves high performance by using etcd for storage, hash tables for storing IP addresses, and radix trees for routing.

October 16, 2023

by Navendu Pottekkat

· 2,569 Views · 2 Likes

AWS Lambda Pricing for a Serverless Application

In this blog post, we’ll briefly compare AWS Lambda Pricing with other Cloud providers and discuss the key elements of the AWS Lambda pricing model.

October 16, 2023

by Rahul Shivalkar

· 3,161 Views · 1 Like

Nebraska.Code() — Developing in the Great Plains

With topics ranging from OSS contribution to getting along with your coworkers to using Azure Key Vault at scale, there was a lot of knowledge shared.

October 16, 2023

by Dwayne McDaniel

· 2,803 Views · 1 Like

Unlocking Efficient AuthZ With Cerbos’ Query Plan

Cerbos efficiently handles the majority of access control decisions for standard application requirements. Its query plan handles the most challenging cases.

October 16, 2023

by Aldin Kiselica

· 2,240 Views · 2 Likes

The Future of AI in Software Development: Trends and Innovations

Explore the ever-changing landscape of AI in software development. Discover emerging trends and innovations shaping the future of coding and programming.

October 16, 2023

by Megha Verma CORE

· 2,324 Views · 2 Likes

Autoscaling Kubernetes Worker Nodes With Karpenter

How to set up and use Karpenter for autoscaling and collecting underutilized spot and on-demand instances for AWS EKS.

October 16, 2023

by Anadi Misra

· 3,491 Views · 2 Likes

Understanding Supervisor in Apache Druid

A supervisor is a built-in part of Druid, making it easier to ingest, analyze, and monitor data in real-time. Learn more!

October 16, 2023

by Gautam Goswami CORE

· 1,967 Views · 2 Likes

Best Practices for Picking PostgreSQL Data Types

In this article, learn which data types best suit your application when storing massive data volumes in PostgreSQL and Timescale.

October 16, 2023

by kelvin steve

· 2,473 Views · 1 Like

Unlocking the Cloud's Best-Kept Secret: Maximize Your Website's Potential With AWS S3 Static Hosting

The article highlights the advantages of hosting static websites on S3, such as high availability, scalability, unlimited bandwidth, and robust security features.

October 16, 2023

by Satrajit Basu CORE

· 2,256 Views · 1 Like

The Latest Data Engineering Topics