Questions
Browse questions with relevant Microsoft Azure tags
10,629 questions
Has recommended answerHow to get metadata (File Shares List) of the Storage account & configure the copy data activity for copying b/w storage accounts in the ADF?
The issue is because you have same dataset for both getmetadata activity and source of copy activity. You can change the dataset of get metadata activity Click +New in the settings of get metadata ...
Listing the Tables in the Storage Account using ADF Web Activity is failed with an authorization error
Make sure you have provided correct SAS. While generating SAS give following permission as shown below: Provide web activity URL as mentioned below: @concat('https://<storageAccountName>.table....
Unable to InferSchema with Databricks SQL
AnalysisException: Unable to infer schema for CSV. It must be specified manually. According to the MS document Databricks recommends the read_files table-valued function for SQL users to read CSV ...
No value provided for parameter `container_name` in the Get Metadata1 activity
It seems like you are using the same source dataset which you have given for copy activity, in the Get meta data activity as well. To list the container names using Get meta data activity, you should ...
How to grant all users of a CLI application with `DeviceCodeCredential` access to resources granted to the application?
Note that, DeviceCodeCredential flow involves user interaction that works on signed-in user's roles. If you want to use the application identity instead, switch to client credentials flow. Initially, ...
I have a file name in epackage - Sell In and Sell Out - Master - NS CBEC_20240711164411.xlsx - ADF Copy activity Dynamic expression
You can try the below expression to achieve your requirement. @{replace(concat(substring(variables('filename'), 0, lastIndexOf(variables('filename'), ' ')),'_',last(split(concat(substring(variables('...
How to do copy of all the containers without explicitly mentioning in the array between two different storage accounts
To achieve your desired requirement, you can follow below procedure: Create binary dataset with source linked services by leaving file path as empty as shown below: Add Get meta data activity to the ...
How can I define the title for each document I import into Azure OpenAI?
Azure OpenAI On Your Data API doesn't have such kind of modifications to ai search only it gives you the results for the search query with citations based on the ai search data. To modify the fields ...
Getting net::ERR_NAME_NOT_RESOLVED error on flutter Azure authentication redirect url
AndroidManifest.xml: <activity android:name="com.yourcompany.yourapp.MainActivity"> <intent-filter android:label="flutter_defaultIntentFilters"> <action ...
Replicating Azure SQL DB and blob storage in multi region setup
Have you tried Azure SQL Data Sync for replicating Azure SQL Database between regions? That could be an option. If you find out the latency with SQL Data Sync and Geo-replication is too high, then you ...
How to bind trigger parameters to appsettings.json under Isolated azure function
Set the schedule expression as an app setting in local.settings.json and use this property in function code by wrapping with % sign i.e., %ScheduleTriggerTime%. Created a .NET 8.0 Isolated Azure ...
Foreign key constraint lost in PostgreSQL table in Azure when data is added using R Script
To ensure that foreign key constraints are not lost when updating the data in your PostgreSQL table, you should avoid using the overwrite = TRUE option in dbWriteTable as it drops and recreates the ...
Rename SharePoint site with Graph API or REST
whats the difference between "Name" and "Site Name"? Whenever you create team site in SharePoint, Microsoft 365 group will also be created automatically with same name as site. ...
Unable to create external data source using Azure SQL Database Emulator
The error you are getting is because External Data Source type RDBMS is only supported in Azure SQL not in local SQL server. while publishing or building the project if you select the Publish to new ...
What does adding/using Application Insights from Visual Studio do?
What does adding/using Application Insights from Visual Studio do? Adding Application Insights from Visual Studio provides an option to create/select the Application Insights Resource and updates the ...
Can I cache BlobContainerClient?
#Can I cache BlobContainerClient? I agree with Andrew B's comment, the GetBlobContainerClient method is a lightweight call, so you may not notice a significant performance difference by caching the ...
Load a Registered Model in Azure ML Studio in an Interactive Notebook
According to this documentation any one of the paths should be given for loading the model. /Users/me/path/to/local/model relative/path/to/local/model s3://my_bucket/path/to/model runs:/<...
Terraform - Azure DataFactory Pipeline empty after runnig succsesfully
While creating azure data factory pipeline using azurerm_data_factory_pipeline tf command, you should not give the entire piepline Json in the activities_json part of terraform code. You can copy only ...
Conditional sorting in Azure Data Factory
You can follow the below approach to achieve your requirement. First create an array parameter cond_arr in the dataflow with your order values ["German","English","French"...
Not able to pass inputs as array to Terraform
Passing inputs as array to Terraform from Terragrunt file The blocker you're facing is because of the way you define object_ids in each policy where it requires to be set of strings but the way you'...
Max retry exceeded when using DeltaTable with Azure Blob Storage
you can control the number of retries and timeouts as shown below: datalake_vale = { 'account_name': account_name, 'client_id': client_id, 'tenant_id': tenant_id, 'client_secret': ...
What's the resource group equivalent of subscriptionResourceId and managementGroupResourceId in Bicep?
How would I get the resource's resource group ID? Here is the updated code to fetch the resourcegroup ID from a resource (app service) and assign a role to the app service identity at the resource ...
Move multiple folder structure along files from one blob container to another in different storage accounts using Logic app
Move multiple folder structure along files from one blob container to another in different storage accounts using Logic app You can use below design which worked for me: then: then: Output:
Databricks Performance Tuning with Joins around 15 tables with around 200 Million Rows
A broadcast join, also known as a map-side join, is a join execution strategy that distributes the join operation across cluster nodes. It is highly efficient for joining a large table (fact table) ...
When storing secrets within a Key Vault (Such as 1Password Developer Tools or Azure KeyVault), how do you properly protect the keyvaults secret?
You are not missing a key piece. Outside of the azure environment with no possibilities for using managed identities you need a service principal to access the key vault. You can configure the azure ...
Azure Function Trigger Not Processing Images in PDFs Correctly
To resolve the error of fails to process images with PDFs we add skill of Text Merge skill to existing skill set. The Image processing is indexer-driven, which means that the raw inputs must be in ...
Use pfx certificate to get Microsoft Entra token - Error: secretOrPrivateKey must be an asymmetric key when using RS256
In my case, I ran below OpenSSL commands to create private key and certificate like this: openssl genrsa -out sridemo.pem 2048 openssl req -new -key sridemo.pem -out sridemo.csr openssl x509 -req -...
Azure Traffic Manager and blue/green deployments
To stop all traffic why don't you just disable the endpoint. It is also offered as the solution in the post you mention: In this example we set the first endpoint Blue.contoso.com with a weight of 1,...
Server failing to authenticate request when using Azurite to copy blob from one container to another
AuthorizationFailure, (Exception: HttpResponseError: Server failed to authenticate the request. Make sure the value of the Authorization header is formed correctly including the signature.) According ...
spring boot auto-configure Azure EventHub handshake issue
Here, you need to change the above application.yml file format and also Additionally, needed slight adjustment as you can check that in the below steps. application.yml: spring: cloud: azure: ...
SharepointList to Azure synapse
As per the Documentation, For lookup data type in the source you need to give int32 as target data type and for Yes/No, give Boolean data type. There is no complex data type in the documentation. So, ...
Spark reading CSV with bad records
You can use the .option("mode", "DROPMALFORMED") to skip bad rows. df = sqlContext.read \ .format("com.databricks.spark.csv") \ .option("header", "...
Calculation of outlier score in series_outlier method
You can use below code to use series_outlier method: import pandas as r from scipy.stats import norm as r_nm import numpy as rn rith_test = { 'r_sr': [67.95675, 58.63898, 33.59188, 4906.018, 5....
Azure Function .Net Code Issue for HttpRequest and BlobServiceClient Assembly or namespace
I have done few modifications to your code and able to read excel file from Azure Blob Storage. Code Snippet: //using .. using Azure.Storage.Blobs; using OfficeOpenXml; using System.Text; public ...
Scheduled alert rule created in Terraform doesn't work
Adding Kind property is not exactly required when you are scheduling monitor log alert query. Because the resource azurerm_monitor_scheduled_query_rules_alert_v2 itself mentioning that it is ...
Azure Service Bus - Differentiating between Messages on the same Topic
There are two options I can think of for this scenario. Subscription/Function per message type Single subscription/Function for all messages Regardless of the method you choose, you'll need to stamp ...
How I can to import my automation account job schedule in Terraform?
Import my automation account job schedule in Terraform The error you're facing is because of the way you providing the import command. To import the job schedule we need to specify the id of job ...
How to create linked service in Azure data factory for on premise Rest API
You can check the connection directly in the integration runtime manager only. Below are the steps to check. Open Integration runtime configuration manager. Click Diagnostics tab in the dialog box. ...
Unable to create Win11 VM with OS Image under 126GB
I do agree with Julian Hüppauff,You can use Hyper-V to create a VM with a disk size of 80GB and install the OS on the same disk. In Hyper-V, you have more control over the disk size. In Azure, if you ...
Why are PublicClientApplicationBuilder requires client(app) Secret?
I agree with @TinyWang, PublicClientApplicationBuilder does not require client secret. Refer this MS Document. The error occurs if you missed enabling public client flow option or added redirect URI ...
Databricks Generating Error: AnalysisException: [ErrorClass=INVALID_PARAMETER_VALUE] Missing cloud file system scheme
INVALID_PARAMETER_VALUE] GenerateTemporaryPathCredential uri /mnt/files/Iris.parquet is not a valid URI. Error message: INVALID_PARAMETER_VALUE: Missing cloud file system scheme. When working with ...
After upgrading Azure AI Search to V11, new SearchOptions do not provide an option to specify fields count we can highlight
As per this document below is the requirement for using highlight. Fields must be Edm.String or Collection(Edm.String) Fields must be attributed at searchable If not, please configure to meet ...
Using Azure Text Analytics to Detect Language per Sentence Instead of Paragraph
Text Split cognitive skill in Azure is not what you are thinking Please follow this documentation to understand what azure ai search actually is. But if you wish to combine both the services possible ...
Azure DevOps release pipeline has suddenly started failing
Based on the error message , we can conclude that the deployment failed with the error : "ClientIpAddressNotAuthorized" , which means that the request was forbidden due to Workspace not ...
Unable to setup continuous deployment in new Azure Container App due to "deny assignment" error
Failed to set up continuous deployment with error: The client '{email-address}' with object id '{user-uuid}' has permission to perform action 'Microsoft.Resources/deployments/write' on scope '/...
Unable to Create Delta Table in Databricks Premium. No problems creating Delta Table Databricks Community Version
When I tried to register the Delta table using the deltadf = DeltaTable.forName(spark, f"{stageName}.{regName}") Error's: AnalysisException: `BASEsqlArea2`.`Country_users` is not a Delta ...
"Operation not permitted" when trying to compile code in Databricks
When you are using shared cluster, this error comes due to permission constraint in shared cluster. But the recommended ways of installing or importing custom modules is given in this documentation In ...
How to register device on Entra ID programatically
To create and register a new device in the organization, check the below: Create a Microsoft Entra ID application and grant Directory.AccessAsUser.All delegated API permission: Generate auth-code by ...
Verify token from Microsoft Entra ID fails?
Based on your code, you are generating access token for Microsoft Graph API: options.Scope.Add("openid"); options.Scope.Add("profile"); options.Scope.Add("email"); And ...
send queue data with custom expiration in python
I am able to send data but I am unable to custom the expiration time like to 10 seconds 1 day like that. But in azure portal able to do it. below image azure portal. Here is the code to send message ...
Simply submit a proposal, get it approved, and publish it.
See how the process works