Amazon Kinesis Firehose

Amazon Kinesis Firehose is the easiest way to reliably load streaming data into data lakes, data stores, and analytics services. It can capture, transform, and deliver streaming data to Amazon S3, Amazon Redshift, Amazon Elasticsearch Service, generic HTTP endpoints, and service providers like Datadog, New Relic, MongoDB, and Splunk. It is a fully managed service that automatically scales to match the throughput of your data and requires no ongoing administration. It can also batch, compress, transform, and encrypt your data streams before loading, minimizing the amount of storage used and increasing security.

You can easily create a Firehose delivery stream from the AWS Management Console, configure it with a few clicks, and start ingesting streaming data from hundreds of thousands of data sources to your specified destinations. You can also configure your data streams to automatically convert the incoming data to open and standards based formats like Apache Parquet and Apache ORC before the data is delivered.

With Amazon Kinesis Data Firehose, there is no minimum fee or setup cost. You pay for the amount of data that you transmit through the service, if applicable, for converting data formats, and for Amazon VPC delivery and data transfer.

Below are the cmdlets which are available with Amazon Kinesis Firehose

CmdletNameServiceOperation
Add-KINFDeliveryStreamTag                          TagDeliveryStream                             
Get-KINFDeliveryStream                             DescribeDeliveryStream                        
Get-KINFDeliveryStreamList                         ListDeliveryStreams                           
Get-KINFTagsForDeliveryStream                      ListTagsForDeliveryStream                     
New-KINFDeliveryStream                             CreateDeliveryStream                          
Remove-KINFDeliveryStream                          DeleteDeliveryStream                          
Remove-KINFDeliveryStreamTag                       UntagDeliveryStream                           
Start-KINFDeliveryStreamEncryption                 StartDeliveryStreamEncryption                 
Stop-KINFDeliveryStreamEncryption                  StopDeliveryStreamEncryption                  
Update-KINFDestination                             UpdateDestination                             
Write-KINFRecord                                   PutRecord                                     
Write-KINFRecordBatch                              PutRecordBatch                                

You can also check other AWS Services, and each services cmdlets we are providing.

Click on this Link for an Single place, where you get all the PowerShell cmdlets sorted based on the modules.

You can also refer other blogs on PowerShell at link

You can also refer other blogs on Microsoft at link

And also if you required any technology you want to learn, let us know below we will publish them in our site http://tossolution.com/

Like our page in Facebook and follow us for New technical information.

References are taken from Microsoft and AWS

Leave a Reply

Your email address will not be published. Required fields are marked *