Langsung ke konten utama

Postingan

Menampilkan postingan dari Agustus, 2021

Create logging for each Transformation/Jobs into ETL PDI and setup Email notification failure on each component level.

https://www.nexsoftsys.com/articles/pentaho-logging-creation-job-etl-email-notification-failure.html Most of real time production level Pentaho ETL job are of complex design which will result into run time failures. As if job is scheduled to run at predefined time slot it may gets failed due to Data, Network or Database related issues. So while monitoring job execution manually we need to keep close look at the log file, Which is tedious task. While monitoring these complex jobs it may gets error prone. Solution to this problem is by sending an email notification which will provide information related to running status of a job and send email in case of failure occurs. Resulting into lesser response time and making job running again from failure point in short duration of time with greater accuracy. Also,The convenient way to share reports is to set up an email server that can send reports to recipients. This feature works with the report scheduling feature to automate the process of e...

Open-Source ETL Tools Comparison

  Open-Source ETL Tools Comparison https://dzone.com/articles/open-source-etl-tools-comparison For all of your extraction, transformation, and loading needs, here is a helpful list of open source ETL tools to compare. Open source data integration tools can be a low-cost alternative to commercial packaged data integration solutions. And just like commercial solutions, they have their benefits and drawbacks. If you do not have the time or resources in-house to build a custom ETL solution — or the funding to purchase one — an open source solution may be a practical option. Further, open source ETL solutions can be a great fit for smaller projects, or places where data analysis is not mission critical. Keep in mind that most open source ETL solutions will still require some configuration and setup work (if not actual coding). So even if you avoid having to hand code a solution, you still may need to have some systems or programming expertise available. Open-Source ETL Tools Overview Op...