Amazon Kinesis Firehose
Amazon Kinesis Firehose is the easiest way to reliably load streaming data into data lakes, data stores, and analytics services. It can capture, transform, and deliver streaming data to Amazon S3, Amazon Redshift, Amazon Elasticsearch Service, generic HTTP endpoints, and service providers like Datadog, New Relic, MongoDB, and Splunk. It is a fully managed service that automatically scales to match the throughput of your data and requires no ongoing administration. It can also batch, compress, transform, and encrypt your data streams before loading, minimizing the amount of storage used and increasing security.
You can easily create a Firehose delivery stream from the AWS Management Console, configure it with a few clicks, and start ingesting streaming data from hundreds of thousands of data sources to your specified destinations. You can also configure your data streams to automatically convert the incoming data to open and standards based formats like Apache Parquet and Apache ORC before the data is delivered.
With Amazon Kinesis Data Firehose, there is no minimum fee or setup cost. You pay for the amount of data that you transmit through the service, if applicable, for converting data formats, and for Amazon VPC delivery and data transfer.
Below are the cmdlets which are available with Amazon Kinesis Firehose
CmdletName | ServiceOperation |
Add-KINFDeliveryStreamTag | TagDeliveryStream |
Get-KINFDeliveryStream | DescribeDeliveryStream |
Get-KINFDeliveryStreamList | ListDeliveryStreams |
Get-KINFTagsForDeliveryStream | ListTagsForDeliveryStream |
New-KINFDeliveryStream | CreateDeliveryStream |
Remove-KINFDeliveryStream | DeleteDeliveryStream |
Remove-KINFDeliveryStreamTag | UntagDeliveryStream |
Start-KINFDeliveryStreamEncryption | StartDeliveryStreamEncryption |
Stop-KINFDeliveryStreamEncryption | StopDeliveryStreamEncryption |
Update-KINFDestination | UpdateDestination |
Write-KINFRecord | PutRecord |
Write-KINFRecordBatch | PutRecordBatch |
You can also check other AWS Services, and each services cmdlets we are providing.