Marg Matillion ETL

looping needs to be keep in place and scheduling should easier.

Integrating data with several sources and aggregate data in the facts.

Think about whether you are looking for a data pipeline into Snowflake, or looking for a full integration (iPaaS) tool. Matillion is outstanding as a one-direction data pipeline, but is not an integration tool.

Matillion allowed us to very quickly and easily get our data pipelined into Snowflake data warehouse from a variety of sources.

ETL, picking up data from various sources, transforming, and dropping into our virtual data lake layer.

User Friendly (but simple) user interface is big plus point. Tools which I have used are either power full with complex User interface or simple and basic. Because of simple user interface and drag and drop functionality it provides various components right from AWS, Google Cloud, Azure and also can execute python, R scripts or custom programs.

This enables users / developer to learn it very quickly than any other tool or scripts.

Many cloud base tools always provides trial of 7 / 14 / 30 days (or some credit) so that more people can try it out. I am sure there must be reason but if you can provide such facility then more people get opportunity to try it out and provide. like google provides $300 credit along with it if Matillion provides then clients can try end to end data flow.

There are few factors can be considered in mind

1) Minimal Learning Curve: Matillion has pre-defined courses which are very practical and takes your practical implementation. within a couple days of efforts any developer can get familier with tool and get started with project.

2) User Interface: User Interface is such that it is easier for anyone (Like business analyst) to review the flow and rectify rather than line by line coding. This makes it easier for long run

3) Cloud base: This is light weight as zero installation is required. So from developer perspective this is best thing one can get

4) Execution and validation is very quick so it can be done easily.

So I would definitely recommend tool for anyone who is starting data management project.

our proposed flow is where we need to connect data sources from AWS (Redshift) , SQL Server and load into Big Query. So Matillion comes very handy with connectors and all possible combinations of joining, combining data at interface.

Connecting diverse datasets is huge benefit. Lot of tools do not offer cloud components. As compare to it, this is big advantage.

Their tool is almost complete and helps a lot during the ETL process.

The interface is pretty cool and easy to be understood.

The tool performance is also something relevant and brings a lot of gains.

It was really easy to create a connection between my RDS Database, Matillion, and Redshift.

Their idea of flow it's pretty cool and easy to follow every day.

I am also using the feature of schedule the runs, which works as a job, running the entire flow as set by myself, reducing the amount of data that we would transfer if the often was less frequently.

Another nice thing is how to subscribe to their tool, I could easily manage that using the AWS Market Place where I have the option to subscribe for the product and all the costs goes directly to my AWS account and I pay per hour, so I can run and stop my instance anytime and avoid some undesired costs.

Their support team is not that fast and sometimes it's hard to find solutions on their documentation.

I had a support case which stayed open for 4 days and I didn't get any reply, I had to find a workaround by myself.

Some data types for Redshift they do not support.

Check their documentation before subscribe and be sure that they have all you need.

I could solve our problem by doing the whole ETL process using Matillion to extract data from RDS and send it to RedShift and do not creating a homemade tool.