Articles

Streaming Data From Files Into Multi-Broker Kafka Clusters

,

There are multiple ways to ingest data streams into the Apache Kafka topic and subsequently deliver to various types of consumers who are hooked to the topic. The stream of data that collects continuously from the topic by consumers, passes through multiple data pipelines and then stream processing engines like Apache Spark, Apache Flink, Amazon Kinesis, etc and eventually landed upon the real-time applications to deliver a final data-driven decision. From finances, manufacturing, insurance, telecom, healthcare, commerce, and more, real-time applications are becoming the best solution for organizations to take immediate action, gain insights from the updated data. In the present day, Apache Kafka shapes the central nervous system that brings data from all aspects of the business to the large information operational hubs where choices are made.

The text files contain unformatted ASCII text and are commonly used for the storage of information. Each line of the file represents a data record and can be updated continuously to store. Every insert of a new line or lines on the text file can be considered as new data insertion on the file. Henceforth, every addition of a new line or lines on the text file continuously either by humans or applications (no modification on the already inserted line)and subsequently moves or sends to a different location can be considered as data streaming from the file. Every addition of a new line or row in the text file can be analyzed continuously by exporting the new line/lines to the Kafka topic and importing them by consumers that hooks up with the topic.

Source de l’article sur DZONE

/par

How to Choose a Bare Metal Server From OVHcloud

,

There are dozens of factors that influence the UX of your site, app, or game. Most of them are beyond your control; user connection speed, end-system resources, even browser technology is all out of your hands. So when you do have the opportunity to influence your project’s infrastructure, you should seize it.

The world’s fastest muscle car can’t perform at its best when traffic is gridlocked bumper to bumper; likewise, the most finely tuned website can’t meet its potential running on shared hosting.

If you want your website, application, or service to run quickly and securely, maximizing both UX and SEO, then you need to look at the bare metal servers from OVHcloud.

Bare Metal Performance

Bare metal (or dedicated) servers aren’t uncommon. Still, most hosts only offer a single type of server, expecting small startups to pay for resources at the same rate as global giants, which can make dedicated hosting prohibitively expensive.

OVHcloud is different; it offers a range of bare metal server products optimized for a wide variety of challenges. That means small startups can invest in fast, easily scalable solutions that meet the most demanding security requirements without breaking the bank.

Whatever your aims, there’s a different OVHcloud solution configured for you:

OVHcloud Rise

Rise is the perfect option for a website, or web app hosting. With its low entry-cost, Intel-powered performance, bundled DDoS protection, and simplified administration, Rise is the natural choice for your first step into bare metal servers.

OVHcloud Advance

To meet SMEs’ need for reliable infrastructure to run mission-critical applications, OVHcloud configured Advance. From in-house CRMs to web-facing SaaS products, Advance is a solid foundation upon which to build your business.

OVHcloud Storage

Storage is ideal for storing large amounts of data securely. Hosting data on standard servers is a colossal waste of resources; with OVHcloud’s Storage product you can host up to 504TB and seamlessly access it via a performance-tuned server.

OVHcloud Infrastructure

For large companies with thousands of employees, global non-profits, colleges, and even local governments, OVHcloud Infrastructure offers scalability and flexibility beyond the average dedicated server.

OVHcloud High-End

For web apps that are leveraging cutting edge technology like machine learning and big data, OVHcloud’s High-End product is a no-compromise custom solution, the humdinger of bare metal servers, with every conceivable option available.

OVHcloud Game

If you’re developing video games, then lightning-quick, reliable streaming servers are essential. OVHcloud’s Game product delivers the type of speed your customers demand, with massive performance gains over comparable bare metal servers.

How to Choose a Bare Metal Server

It’s easy to get bogged down in detail, especially if this is your first foray into bare metal servers.

But here’s the good news: every OVHcloud bare metal server is a massive boost in performance over shared web hosting. That’s because, with a dedicated server, all of the server’s resources are…dedicated; that is, you don’t have to share with anyone. Shared hosting is pot-luck: You might wind up on a server with thoughtful users who don’t eat up all the resources, and you might end up on a server with one selfish user who hogs the processes and compromises the security. With a bare metal server, that’s not an issue.

Choosing a bare metal server is a two-step process. The first step is to think about what you intend to use it for:

Are you going to store a lot of data? If so, think about OVHcloud’s Storage product. But a lot of data doesn’t mean a WordPress blog. Let’s say you’re a polling company, collating millions of records that you hope to analyze to predict political movement; that requires a lot of storage. On the other hand, all servers have some storage. OVHcloud’s Rise product comes with 500Gb and can be configured with more. So if you’re planning to host something the size of a blog, then OVHcloud’s Storage might be using a sledgehammer to crack a nut.

The second step is to ask how complex the operations you’re going to ask the server to perform will be:

Hitting up a database to retrieve some data is not a complex operation. Even something like a complex search isn’t too taxing. If that’s the kind of process you expect to perform, OVHcloud’s Rise is more than adequate. But if you’re manipulating large amounts of data, like resizing hundreds of raster images dynamically; or using facial recognition to search through millions of biometric data records; or even managing your advertising application serving millions of ads to sites across the web; in those cases, you need the sort of performance OVHcloud’s Infrastructure product delivers.

OVHcloud’s products are all scaleable. Its High-End bare metal server product is entirely customizable. Whatever you choose, and however your needs change over time, you can be confident you’re running the optimum server for your project.

Why Choose OVHcloud

There are a mind-boggling array of processors, and OS, and a seemingly infinite — and increasingly expensive — amount of hardware on offer on the web. OVHcloud radically simplifies running a bare metal server by delivering a range of popular packages, tailored for everyday uses, that are both customizable and scaleable.

What OVHcloud delivers is a clear choice, letting you choose the right server for your product.

Whether you need lighting fast response times to maximize your SEO or the space to store a digital archive of the world’s most important art, for reliability and choice, opt for OVHcloud bare metal servers.

 

[— This is a sponsored post on behalf of OVHcloud —]

Source

The post How to Choose a Bare Metal Server From OVHcloud first appeared on Webdesigner Depot.


Source de l’article sur Webdesignerdepot

/par

Big / Bug Data: Analyzing the Apache Flink Source Code

,

Applications used in the field of Big Data process huge amounts of information, and this often happens in real time. Naturally, such applications must be highly reliable so that no error in the code can interfere with data processing. To achieve high reliability, one needs to keep a wary eye on the code quality of projects developed for this area. The PVS-Studio static analyzer is one of the solutions to this problem. Today, the Apache Flink project developed by the Apache Software Foundation, one of the leaders in the Big Data software market, was chosen as a test subject for the analyzer.

So, what is Apache Flink? It is an open-source framework for distributed processing of large amounts of data. It was developed as an alternative to Hadoop MapReduce in 2010 at the Technical University of Berlin. The framework is based on the distributed execution engine for batch and streaming data processing applications. This engine is written in Java and Scala. Today, Apache Flink can be used in projects written using Java, Scala, Python, and even SQL.

Source de l’article sur DZONE

/par

Exploitez la puissance de SAP HANA dans vos applications, avec une licence full use

, ,

Avec la licence Enterprise Edition, vous accéderez sans restrictions à la base de données SAP HANA. Découvrez en quoi le passage à une licence full use peut être avantageux pour vos données et applications métiers.

Il y a 10 ans, SAP présentait un outil de gestion de bases de données de nouvelle génération, SAP HANA. Une offre présentant plusieurs caractéristiques clés :

  • In memory : les données sont lues et écrites en mémoire, pour des performances extrêmes
  • Orienté lignes : ce mode permet d’optimiser l’écriture (un enregistrement par ligne)
  • Orienté colonnes : ce mode facilite les requêtes (un type de données par colonne)

Cette double casquette ligne/colonne permet à SAP HANA d’adresser à la fois les traitements transactionnels et analytiques. Des technologies avancées gravitent autour de ce cœur : serveur d’applications, scripting, prédictif, Machine Learning, vues OLAP, graphes, gestion des données spatiales…

L’ensemble propose à la fois une connexion aux applications SAP (BICS) ou non (SQL et MDX). Il est également possible d’accéder à des sources de données tierces via Smart Data Streaming et Smart Data Access et aussi d’intégrer quasiment n’importe quel type de données, structurées ou non, jusqu’aux sources Hadoop, au travers de Smart Data Integration. Tout ceci est combiné avec des fonctions de partionning, de haute disponibilité, de répartition de charge, de parallélisation des requêtes, d’aide à la reprise d’activité, etc.

SAP HANA est aujourd’hui au cœur de nombreuses applications SAP. Il est également possible de l’utiliser en mode autonome. « Dans les deux cas, l’ensemble des fonctionnalités est disponible, car il n’existe qu’une seule version de SAP HANA », explique Olivier Demeusy, Director at Center of Excellence, EMEA North for SAP Business Technology Platform.

Runtime VS Enterprise

La principale différence entre SAP HANA Runtime Edition et SAP HANA Enterprise Edition réside dans le mode d’accès à la base de données et les restrictions s’y appliquant :

  • L’édition Runtime est conçue pour les applications SAP et ne peut être adressée qu’à travers ces applications
  • L’édition Enterprise est accessible sans restrictions depuis n’importe quel système ou application, SAP ou non.

La Runtime Edition n’autorise donc l’interaction avec la base de données qu’au travers des applications SAP, qui vont se charger de lancer les requêtes. L’Enterprise Edition est pour sa part accessible depuis les applications SAP, des applications tierces ou vos propres applicatifs métiers.

L’accès pourra se faire en direct au travers de requêtes SQL. Les fonctions d’intégration et de qualité de données pourront être librement exploitées, tout comme les moteurs avancés de SAP HANA. Enfin, de multiples ponts seront accessibles afin de lier du code métier à SAP HANA. Et ce jusqu’à l’hébergement de vos applications dans SAP HANA. SAP HANA XS Advanced permet en effet le développement d’applications natives SAP HANA, capables de fonctionner au plus près de la donnée.

Un changement de licence facilité

Passer de la Runtime Edition à l’Enterprise Edition est aisé, SAP HANA restant identique dans les deux cas. « Le passage d’une licence à l’autre ne se traduit par aucun changement technique », confirme Olivier Demeusy.

Le tarif comprend un coût d’acquisition et une maintenance annuelle. « Le tarif appliqué dépend directement du volume de données qui sera pris en charge par SAP HANA, avec un calcul effectué par blocs de 64 Go. » Que vous utilisiez une base de données de 500 Go ou de 20 To, vous aurez donc toujours la garantie de bénéficier d’une offre parfaitement ajustée.

The post Exploitez la puissance de SAP HANA dans vos applications, avec une licence full use appeared first on SAP France News.

Source de l’article sur sap.com

/par

Why AI & Automation Are Actually Friends to Design

,

Artificial intelligence. Just hearing the phrase has been a trigger for many in the technology world since that creepy Haley Joel Osment film circa 2001. But more recently, artificial intelligence and machine learning strike fear into the hearts of skilled workers for an entirely different reason: job security, or lack thereof.

Smart-home devices, streaming services, self-checkouts, even Google searches are ways that artificial intelligence has seeped into everyday life, exemplifying the abilities of computers and machines to master both simple and complex tasks. In some instances, these technological advancements make our lives easier, but for some people, their proliferation has meant job loss and skill replacement. There’s no wonder that when artificial intelligence starts being mentioned along with web design and site creation, the spidey senses of designers all over the world start tingling.

designers think outside the box, something that AI just can’t do

But let’s get real about what AI and automation really mean for designers for a second. Talented designers with busy schedules should view these advancements as virtual assistants. For some small businesses on a limited budget, the websites that artificial intelligence can pump out might be fine…for a while. However, as businesses grow, change, require updating and customization to adapt to their customer base, the expertise of creative and talented designers will always be needed. Even the best AI that we see today is limited by evaluating, replicating, and revising what already exists. It may be able to mix 1,000 different color schemes into 10 million potential combinations, but great designers think outside the box, something that AI just can’t do.

In fact, rather than being scared of automation, designers ought to embrace automation and artificial intelligence as a way to unleash their creative thinking. Delegate repetitive, straightforward tasks to the right software, and suddenly you have time to bring your best ideas to the table and push the boundaries of your own innovation. 

Where AI has Failed in Design

The ultimate goal of artificial intelligence and automation in design work is a grand vision that has yet to be realised.

Consider the case of The Grid, which began as a crowdfunding campaign in 2014. The “revolutionary” product posed itself as an artificial intelligence solution for building thoughtfully, yet automatically, designed websites in five minutes. Research “Reviews of the Grid” in any search engine and you’ll be met with scathing criticism with only some small praise sprinkled in. Most of the initial users cite underwhelming results, the feeling of being duped by the Grid’s marketing tactics, nonsensical placement of text, and ultimately, the Grid being a complete waste of money for the resulting product. Even at the low cost of $100, compared to hiring a talented designer, most users felt their investment was wasted.

For the AI capabilities that exist now, most small business owners, or those looking to put together a simple website, are better off using drag and drop site builders (Wix, Squarespace, Weebly, etc) that have been around for ages. Even so, there are plenty of businesses still willing to hire designers to take this simple task off their plate due to a lack of technical expertise or lack of time. And let’s be honest, are there even enough talented (keyword here!) designers out there to keep up with the millions of websites created every year, without each one working themselves to death? 

Where Automation Shines for Designers

Fortunately for good designers, it appears for now that the days of artificial intelligence completely taking over their jobs is a fantasy. However, what AI and automation do offer designers is a solid starting point for success, eliminating much of the lower-level grunt work that most designers would rather skip anyway.

Even well-received AI website builders like Firedrop still require a basic eye for design and specialised knowledge to produce truly unique, high-converting, and user-friendly websites. Tools and practices that designers should adopt are the artificial intelligence and automation resources that will help them do their jobs better, faster, and leave them with more time to focus on project elements that AI cannot accomplish on its own.

Bridging the Gap Between Designers and Developers

Well-established brands are likely to already have design systems in place that guide the creation of new elements across their digital profiles whether on social media, various mobile apps, or different sections of a website. But even in large corporations — excepting those who have perfected the process — there’s often a breakdown between a designer’s vision and resulting product from the developers. It stems from the basic difference in how they each approach their work and the limitations of the systems they use.

While component libraries — or even full design systems for that matter — won’t reconcile every question, they provide both developers and designers a source of truth to work from that both parties can understand. Design collaboration tools like Invision and Visme, specifically, keep designers and developers on the same page with automated version saving and code-friendly workflows.  

Understanding the Consumer

I don’t suggest using artificial intelligence to produce content for your site

Digging into and understanding the behaviours and habits of site users is a relatively new component of site design, but offers invaluable insights. Tools like HotJar, Mouseflow, or Smartlook make it simple to see holes or leaks in your conversion funnels, detect which page elements users are interacting with, and which they’re not interested in to refine the look and feel of a page for maximum conversions. Even though these tools provide the data, it still takes a keen eye and understanding of design to implement the right changes to improve site performance.

Site content is another way that artificial intelligence has the potential to improve our understanding of customer behaviour and improve site performance for individual users. I don’t suggest using artificial intelligence to produce content for your site, no matter how much the results have improved. However, static landing pages or a single set of further reading recommendations are unlikely to appeal to the majority of site visitors. Artificial intelligence tools like CliClap and Personyze instantly collect and analyse consumer data to provide dynamic, personalised experiences that drive more leads and encourage conversions. Creative designers will also learn from this data to improve customer experience with other pages or elements throughout the site.

Removing Distracting, Time-Sucking Administrative Tasks

Because “artificial intelligence” has become a term with such negative connotations, we often overlook the simple way that AI actually makes our work lives better and easier. Machine learning in email filtering is a great example of this. Consider a simple interface like a Gmail inbox. We have the option to mark certain senders as spam or as important, and our inbox learns that type of communication is and isn’t useful to the user. Pandora, Spotify, Apple Music, and more all take cues from the user behaviour of liking a certain song, artists, or genre of music to build customised playlists. There are a myriad of ways that artificial intelligence and its branches of disciplines merge with our everyday lives. 

Some of the most useful automations for business, and especially for designers, are related to the administrative tasks that frequently take time away or distract from more pressing projects. A perfect example of automation that can relieve stress and cut down on mindless work is an email autoresponder. I’ve always found that having time blocked off in my calendar to tackle complex or important projects helps me to focus on the task at hand and be more efficient. In order to more effectively block out my time, closing my email and setting an autoresponder to reply to all incoming emails serves two purposes: 

  1. Lets those trying to get in touch with me know that I only check my email at certain times of the day and that my response may not be immediate — tempering their expectations of when they might hear from me.
  2. Relieves my personal stress of being tethered to my inbox, splitting my focus, and also saves the time of having to initially respond to each email individually. 

This is just one simple way to use automation in your email, although there are many others to explore.

While Zapier isn’t the only workflow automation service on the market, it’s probably the most well known. Workflow automation reduces time spent on mind-numbing, repetitive tasks and helps designers connect apps that might not natively work together. Do you keep a task list in Todoist? Set up a Zap, then create a task in Todoist anytime someone mentions you on Asana or assigns you a task in Trello.

This is especially helpful for freelance designers who work with multiple clients across various project management platforms. The potential for automation to relieve unnecessary mental overhead for designers is nearly limitless.

Don’t be Afraid of AI, Embrace It

The bottom line of this brief overview of artificial intelligence and automation in design is that this emerging technology isn’t something designers should be scared of. In fact, it’s something to welcome with open arms because ultimately it can make our jobs, and our lives, better. Leave the monotonous tasks of collecting and analysing huge amounts of data or administrative minutiae to the machines; they can handle it.

Save the interesting, creative, abstract work for the talented designers who can turn AI recommendations into unique and intuitive digital experiences. Making the relationship between artificial intelligence and design symbiotic will yield the best results for every entity involved: the business, the AI, and yes, even the designer.

 

Featured image via Unsplash.

Source


Source de l’article sur Webdesignerdepot

/par

Editors’ Picks: Summer 2020

,

Agile 

AI

Big Data

Cloud

Database

DevOps

Integration

  • Mulesoft 4: Continuous Delivery/Deployment With Maven by Ashok S — This article is a great example of what we want every tutorial to look like on DZone. The main aim of this article is to provide a standard mechanism to release project artifacts and deploy to Anypoint Platform, from the local machine or configure in continuous delivery pipelines.
  • Integration With Social Media Platforms Series (Part 1) by Sravan Lingam — This article helps you to build a RESTful API through MuleSoft that integrates with LinkedIn and shares a post on behalf of one’s personal account. I like this article because, in the age of social media, it’s so important for businesses to be connected and integrated!

IoT

Java

Microservices

Open Source

Performance

  • What Is Big O Notation? by Huyen Pham — Aside from a silly name, this article is an example of an in-depth analysis on a little-spoken-about concept. In this article, take a look at a short guide to get to know Big O Notation and its usages.
  • Is Python the Future of Programming? by Shormisthsa Chatterjee — Where is programming going? This article attempts to answer this question in a well-rounded way. The author writes, "Python will be the language of the future. Testers will have to upgrade their skills and learn these languages to tame the AI and ML tools".

Security

Web Dev

  • A Better Way to Learn Python by Manas Dash: There’s so many resources available for learning Python — so many that it’s difficult to find a good and flexible place to start. Check out Manas’ curated list of courses, articles, projects, etc. to get your Python journey started today. 
  • Discovering Rust by Joaquin Caro: I’m a sucker for good Rust content, as there’s still so many gaps in what’s available. Joaquin does a great job of giving readers his perspective of the language’s features in a way that traditional docs just 

Source de l’article sur DZONE

/par

In Memory of Flash: 1996-2020

We are gathered here today….

Today I write in memory of Adobe Flash (née Macromedia), something that a bunch of people are actually too young to remember. I write this with love, longing, and a palpable sense of relief that it’s all over. I have come to praise Flash, to curse it, and finally to bury it.

We’ve been hearing about the death of Flash for a long time. We know it’s coming. December 2020 has been announced as the official timeframe for removal, but let’s be real about this: it’s dead. It’s super-dead. It’s people-are-selling-Flash-game-archives-on-Steam dead.

That last bit actually makes me happy, because Flash games were a huge part of my childhood, and the archives must be preserved. Before I’d ever heard of video cards, frames per second, and “git gud”, I was whiling away many an hour on disney.com, cartoonnetwork.com, MiniClip, Kongregate, and other sites, looking for games.

I think we’ve established in my previous work that even as a missionary kid, I did not have a social life.

The Internet itself gave me a way to reach out and see beyond my house, my city, and my world, and it was wonderful. Flash was a part of that era when the Internet felt new, fresh, and loaded with potential. Flash never sent anyone abuse, or death threats. Flash was for silly animations, and games that my parent’s computer could just barely handle, after half an hour of downloading.

I even built my first animated navigation menus in Flash, because I didn’t know any better. At all. But those menus looked exactly like the ones I’d designed in Photoshop, so that’s what mattered to me, young as I was.

That was a part of Flash’s charm, really.

What Flash Got Right

Flash Brought Online Multimedia into the Mainstream

Funny story, JavaScript was only about a year old when Flash was released. While HTML5 and JS are the de-facto technologies for getting things done now, Flash was, for many, the better option at launch. JS had inconsistent support across browsers, and didn’t come with a handy application that would let you draw and animate whatever you wanted.

It was (in part) Flash that opened up a world of online business possibilities, that made people realize the Internet had potential rivalling that of television. It brought a wave of financial and social investment that wouldn’t be seen again until the advent of mainstream social networks like MySpace.

The Internet was already big business, but Flash design became an industry unto itself.

Flash Was Responsive

Yeah, Flash websites could be reliably responsive (and still fancy!) before purely HTML-based sites pulled it off. Of course, it was called by other names back then, names like “Liquid Design”, or “Flex Design”. But you could reliably build a website in Flash, and you knew it would look good on everything from 800×600 monitors, to the devastatingly huge 1024×768 screens.

You know, before those darned kids with their “wide screens” took over. Even then, Flash still looked good, even if a bunch of people suddenly had to stop making their sites with a square-ish aspect ratio.

Flash Was Browser-Agnostic

On top of being pseudo-responsive, the plugin-based Flash player was almost guaranteed to work the same in every major browser. Back in a time when Netscape and Internet Explorer didn’t have anything that remotely resembled feature parity, the ability to guarantee a consistent website experience was to be treasured. When FireFox and Chrome came out, with IE lagging further behind, that didn’t change.

While the CSS Working Group and others fought long and hard for the web to become something usable, Flash skated by on its sheer convenience. If your site was built in Flash, you didn’t have to care which browsers supported the <marquee> tag, or whatever other ill-conceived gimmick was new and trendy.

Flash Popularized Streaming Video

Remember when YouTube had a Flash-based video player? Long before YouTube, pretty much every site with video was using Flash to play videos online. It started with some sites I probably shouldn’t mention around the kids, and then everyone was doing it.

Some of my fondest memories are of watching cartoon clips as a teenager. I’d never gotten to watch Gargoyles or Batman: The Animated Series as a young kid, those experience came via the Internet, and yes… Flash. Flash video players brought me Avatar: The Last Airbender, which never ever had a live action adaptation.

Anyway, my point: Flash made online video streaming happen. If you’ve ever loved a Netflix or Prime original show (bring back The Tick!), you can thank Macromedia.

What Flash Got Wrong

Obviously, not everything was rosy and golden. If it was, we’d have never moved on to bigger, better things. Flash had problems that ultimately killed it, giving me the chance, nay, the responsibility of eulogizing one of the Internet’s most important formative technologies.

Firstly, it was buggy and insecure: This is not necessarily a deal-breaker in the tech world, and Microsoft is doing just fine, thank you. Still, as Flash matured and the code-base expanded, the bugs became more pronounced. The fact that it was prone to myriad security issues made it a hard sell to any company that wanted to make money.

Which is, you know, all of them.

Secondly, it was SEO-unfriendly: Here was a more serious problem, sales-wise. While we’re mostly past the era when everyone and their dog was running a shady SEO company, search engines are still the lifeblood of most online businesses. Having a site that Google can’t index is just a no-go. By the time Google had managed to index SWF files, it was already too late.

Thirdly, its performance steadily got worse: With an expanding set of features and code, the Flash plugin just took more and more resources to run. Pair it with Chrome during that browser’s worst RAM-devouring days, and you have a problem.

Then, while desktops were getting more and more powerful just (I assume) to keep up with Flash, Apple went and introduced the iPhone. Flash. Sucked. On. Mobile. Even the vendors that went out of their way to include a Flash implementation on their smartphones almost never did it well.

It was so much of a hassle that when Apple officially dropped Flash support, the entire world said, “Okay, yeah, that’s fair.”

Side note: Flash always sucked on Linux. I’m just saying.

Ashes to Ashes…

Flash was, for its time, a good thing for the Internet as a whole. We’ve outgrown it now, but it would be reckless of us to ignore the good things it brought to the world. Like the creativity of a million amateur animators, and especially that one cartoon called “End of Ze World”.

Goodbye Flash, you sucked. And you were great. Rest in peace. Rest in pieces. Good riddance. I’ll miss you.

 

 

Featured image via Fabio Ballasina and Daniel Korpai.

Source


Source de l’article sur Webdesignerdepot

/par

Deep Dive Into Apache Flink’s TumblingWindow – Part 1

,

In this article, I will share coding examples some of the key aspects of TumblingWindow in Flink. Those not familiar with Flink streaming can get an introduction here. 

Before we get into TumblingWindow, let us get a basic understanding of  "Window" when it comes to stream processing or streaming computation.  In a data stream you have a source that is continuously producing data, making it unfeasible to compute a final value.  

Source de l’article sur DZONE

/par

Kafka Consumer Delivery Semantics

,

This article is a continuation of part 1 Kafka technical overview, part 2 Kafka producer overview, part 3 Kafka producer delivery semantics and part 4 Kafka consumer overview. Let’s understand different consumer configurations and consumer delivery semantics.

Subscribe

To read records from Kafka topic, create an instance of Kafka consumer and subscribe to one or more of Kafka topics. You can subscribe to a list of topics using regular expressions, for example,  myTopic.*.

Source de l’article sur DZONE

/par