AWS Glue

AWS Glue is a fully managed extract, transform, and load (ETL) service that makes it easy to prepare and load your data for analytics. You can create and run an ETL job with a few clicks in the AWS Glue visual editor. You simply point AWS Glue to your data stored on AWS or a JDBC-compatible source and AWS Glue discovers your data and stores the associated metadata (e.g. table definition and schema) in the AWS Glue Data Catalog. Once cataloged, your data is immediately searchable, queryable, and available for ETL.

Below are the cmdlets which are available with AWS Glue

CmdletNameServiceOperation
Add-GLUEResourceTag                                TagResource                                   
Find-GLUETable                                     SearchTables                                  
Get-GLUECatalogImportStatus                        GetCatalogImportStatus                        
Get-GLUEClassifier                                 GetClassifier                                 
Get-GLUEClassifierList                             GetClassifiers                                
Get-GLUEConnection                                 GetConnection                                 
Get-GLUEConnectionList                             GetConnections                                
Get-GLUECrawler                                    GetCrawler                                    
Get-GLUECrawlerBatch                               BatchGetCrawlers                              
Get-GLUECrawlerList                                GetCrawlers                                   
Get-GLUECrawlerMetricList                          GetCrawlerMetrics                             
Get-GLUECrawlerNameList                            ListCrawlers                                  
Get-GLUEDatabase                                   GetDatabase                                   
Get-GLUEDatabaseList                               GetDatabases                                  
Get-GLUEDataCatalogEncryptionSetting               GetDataCatalogEncryptionSettings              
Get-GLUEDataflowGraph                              GetDataflowGraph                              
Get-GLUEDevEndpoint                                GetDevEndpoint                                
Get-GLUEDevEndpointBatch                           BatchGetDevEndpoints                          
Get-GLUEDevEndpointList                            GetDevEndpoints                               
Get-GLUEDevEndpointNameList                        ListDevEndpoints                              
Get-GLUEJob                                        GetJob                                        
Get-GLUEJobBatch                                   BatchGetJobs                                  
Get-GLUEJobBookmark                                GetJobBookmark                                
Get-GLUEJobList                                    GetJobs                                       
Get-GLUEJobNameList                                ListJobs                                      
Get-GLUEJobRun                                     GetJobRun                                     
Get-GLUEJobRunList                                 GetJobRuns                                    
Get-GLUEMapping                                    GetMapping                                    
Get-GLUEMLTaskRun                                  GetMLTaskRun                                  
Get-GLUEMLTaskRunList                              GetMLTaskRuns                                 
Get-GLUEMLTransform                                GetMLTransform                                
Get-GLUEMLTransformIdentifier                      ListMLTransforms                              
Get-GLUEMLTransformList                            GetMLTransforms                               
Get-GLUEPartition                                  GetPartition                                  
Get-GLUEPartitionBatch                             BatchGetPartition                             
Get-GLUEPartitionList                              GetPartitions                                 
Get-GLUEPlan                                       GetPlan                                       
Get-GLUEResourcePolicy                             GetResourcePolicy                             
Get-GLUESecurityConfiguration                      GetSecurityConfiguration                      
Get-GLUESecurityConfigurationList                  GetSecurityConfigurations                     
Get-GLUETable                                      GetTable                                      
Get-GLUETableList                                  GetTables                                     
Get-GLUETableVersion                               GetTableVersion                               
Get-GLUETableVersionList                           GetTableVersions                              
Get-GLUETag                                        GetTags                                       
Get-GLUETrigger                                    GetTrigger                                    
Get-GLUETriggerBatch                               BatchGetTriggers                              
Get-GLUETriggerList                                GetTriggers                                   
Get-GLUETriggerNameList                            ListTriggers                                  
Get-GLUEUserDefinedFunction                        GetUserDefinedFunction                        
Get-GLUEUserDefinedFunctionList                    GetUserDefinedFunctions                       
Get-GLUEWorkflow                                   GetWorkflow                                   
Get-GLUEWorkflowBatch                              BatchGetWorkflows                             
Get-GLUEWorkflowList                               ListWorkflows                                 
Get-GLUEWorkflowRun                                GetWorkflowRun                                
Get-GLUEWorkflowRunList                            GetWorkflowRuns                               
Get-GLUEWorkflowRunProperty                        GetWorkflowRunProperties                      
Import-GLUECatalog                                 ImportCatalogToGlue                           
New-GLUEClassifier                                 CreateClassifier                              
New-GLUEConnection                                 CreateConnection                              
New-GLUECrawler                                    CreateCrawler                                 
New-GLUEDatabase                                   CreateDatabase                                
New-GLUEDevEndpoint                                CreateDevEndpoint                             
New-GLUEJob                                        CreateJob                                     
New-GLUEMLTransform                                CreateMLTransform                             
New-GLUEPartition                                  CreatePartition                               
New-GLUEPartitionBatch                             BatchCreatePartition                          
New-GLUEScript                                     CreateScript                                  
New-GLUESecurityConfiguration                      CreateSecurityConfiguration                   
New-GLUETable                                      CreateTable                                   
New-GLUETrigger                                    CreateTrigger                                 
New-GLUEUserDefinedFunction                        CreateUserDefinedFunction                     
New-GLUEWorkflow                                   CreateWorkflow                                
Remove-GLUEClassifier                              DeleteClassifier                              
Remove-GLUEConnection                              DeleteConnection                              
Remove-GLUEConnectionBatch                         BatchDeleteConnection                         
Remove-GLUECrawler                                 DeleteCrawler                                 
Remove-GLUEDatabase                                DeleteDatabase                                
Remove-GLUEDevEndpoint                             DeleteDevEndpoint                             
Remove-GLUEJob                                     DeleteJob                                     
Remove-GLUEMLTransform                             DeleteMLTransform                             
Remove-GLUEPartition                               DeletePartition                               
Remove-GLUEPartitionBatch                          BatchDeletePartition                          
Remove-GLUEResourcePolicy                          DeleteResourcePolicy                          
Remove-GLUEResourceTag                             UntagResource                                 
Remove-GLUESecurityConfiguration                   DeleteSecurityConfiguration                   
Remove-GLUETable                                   DeleteTable                                   
Remove-GLUETableBatch                              BatchDeleteTable                              
Remove-GLUETableVersion                            DeleteTableVersion                            
Remove-GLUETableVersionBatch                       BatchDeleteTableVersion                       
Remove-GLUETrigger                                 DeleteTrigger                                 
Remove-GLUEUserDefinedFunction                     DeleteUserDefinedFunction                     
Remove-GLUEWorkflow                                DeleteWorkflow                                
Reset-GLUEJobBookmark                              ResetJobBookmark                              
Set-GLUEDataCatalogEncryptionSetting               PutDataCatalogEncryptionSettings              
Set-GLUEResourcePolicy                             PutResourcePolicy                             
Start-GLUECrawler                                  StartCrawler                                  
Start-GLUECrawlerSchedule                          StartCrawlerSchedule                          
Start-GLUEExportLabelsTaskRun                      StartExportLabelsTaskRun                      
Start-GLUEImportLabelsTaskRun                      StartImportLabelsTaskRun                      
Start-GLUEJobRun                                   StartJobRun                                   
Start-GLUEMLEvaluationTaskRun                      StartMLEvaluationTaskRun                      
Start-GLUEMLLabelingSetGenerationTaskRun           StartMLLabelingSetGenerationTaskRun           
Start-GLUETrigger                                  StartTrigger                                  
Start-GLUEWorkflowRun                              StartWorkflowRun                              
Stop-GLUECrawler                                   StopCrawler                                   
Stop-GLUECrawlerSchedule                           StopCrawlerSchedule                           
Stop-GLUEJobRunBatch                               BatchStopJobRun                               
Stop-GLUEMLTaskRun                                 CancelMLTaskRun                               
Stop-GLUETrigger                                   StopTrigger                                   
Stop-GLUEWorkflowRun                               StopWorkflowRun                               
Update-GLUEClassifier                              UpdateClassifier                              
Update-GLUEConnection                              UpdateConnection                              
Update-GLUECrawler                                 UpdateCrawler                                 
Update-GLUECrawlerSchedule                         UpdateCrawlerSchedule                         
Update-GLUEDatabase                                UpdateDatabase                                
Update-GLUEDevEndpoint                             UpdateDevEndpoint                             
Update-GLUEJob                                     UpdateJob                                     
Update-GLUEMLTransform                             UpdateMLTransform                             
Update-GLUEPartition                               UpdatePartition                               
Update-GLUETable                                   UpdateTable                                   
Update-GLUETrigger                                 UpdateTrigger                                 
Update-GLUEUserDefinedFunction                     UpdateUserDefinedFunction                     
Update-GLUEWorkflow                                UpdateWorkflow                                
Write-GLUEWorkflowRunProperty                      PutWorkflowRunProperties                      

You can also check other AWS Services, and each services cmdlets we are providing.

Click on this Link for an Single place, where you get all the PowerShell cmdlets sorted based on the modules.

You can also refer other blogs on PowerShell at link

You can also refer other blogs on Microsoft at link

And also if you required any technology you want to learn, let us know below we will publish them in our site http://tossolution.com/

Like our page in Facebook and follow us for New technical information.

References are taken from Microsoft and AWS

Leave a Reply

Your email address will not be published. Required fields are marked *