An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Self-hosted IR 5.66.9620.1 multiplies PostgreSQL numeric values by 10,000 (PostgreSQL 17.8 source)
We copy data from a PostgreSQL database to a Synapse dedicated SQL pool using the PostgreSQL V2 connector (linked service type PostgreSqlV2) through a self-hosted integration runtime. Against our new source server (PostgreSQL 17.8 on x86_64-windows,…
Azure Synapse Analytics
Request for Clarification on Support for SQL Views, Stored Procedures, and Functions in Fabric Mirroring, Dataverse Link to Fabric, and Azure Synapse Link
We are evaluating data access options for Dynamics 365 Finance & Operations, including Direct AxDB Replica Access, Fabric Mirroring, Dataverse Link to Fabric, and Azure Synapse Link. Microsoft documentation clearly describes support for…
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Can we execute a Stored procedure(Azure SQL DB) through synapse Notebook??
I have created stored Procedure which has Merge Statement to perform slowly changing dimension, I would like to execute this Stored procedure from synapse notebook. Is there any way to perform this ?
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Can't Create Database Scoped Credentials in Serverless synapse Database
When I run the below script, I am getting an error saying Incorrect syntax near IDENTITY
Azure SQL Database
An Azure relational database service.
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
How to connect a dedicated sql pool with azure function
I would like to know how to use python in azure function to connect to synapse's dedicated SQL pool.
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Synapse resource class for managed identity
Hi, Is there a possibility to assign the resource class to the Synapse managed identity when it manipulates the dedicated SQL pool data through its pipelines? Since the managed identity is a member of the Synapse Administrator role by default and…
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Execute pipeline from pyspark
Hi, In serverless sql pool, I have a pyspark notebook in which I would like to execute the pipeline, pipeline1. How is this possible?
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Data Modeling in Azure
Hi All, I would really appreciate if someone please help me with Data Modeling books within Azure scope that entails various techniques such as dimensional modeling , data vault. Any good links would be also a great help. Thanks in advance.
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
MOUNTING ADLS GEN2 ON SYNAPSE SPARK POOL
I want to mount datalake to specific mount point , want to read data from there , so i tried the below code mssparkutils.fs.mount( source = "abfss://******@adls.dfs.core.windows.net/", mountPoint = "/mnt/mdpdevfs", extraConfigs…
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
Developer technologies | .NET | Other
Microsoft Technologies based on the .NET software framework. Miscellaneous topics that do not fit into specific categories.
Connect Azure Synapse notebook to Azure SQL Database
I am not using SQL pools in Synapse instead I use only Azure SQL Database. My requirement is to read data from Azure SQL DB through Notebook do some transformations and save the output into Blob Storage. The pipeline in synapse studio is working well…
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
How to load csv files from Sharepoint portal to data lake in azure synapse
I have a requirement to load csv files form a folder in our organization sharepoint portal into Data lake. Any specific connector or config set up required to create such pipeline?
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
External table creation based on table from another server
Hi, I am trying to create an External table in one database server , by accessing some table from another Remote Database server. Creation of External Data source as well as External table was successful. But when I try to query the External…
Azure SQL Database
An Azure relational database service.
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Does Azure Synapse Analytics have support for Python?
What I am trying to do? Glue-Athena-like process. Data in S3 AWS Glue (create metadata tables) Tables can be queried using Athena via boto3 (python library) Problem I am facing in Azure Cloud ~Trying to replicate the above process using…
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Synapse Spark Pool write to Excel workbook on ADLS2 ?
How can I write from Synapse Spark Pool to Excel workbook (multiple sheets) on ADLS2 ? Something like Pandas ExcelWriter()
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Azure Synapse data warehouse Connection string
I have a connection string for azure data warehouse synapse provided by a client. Im a total beginner and it would be a great help if someone could please explain the steps I have to take next to use this connection string to get access to the data…
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
Azure Synapse Serverless query error with Access check for 'CREATE/WRITE' operation against blob failed with HRESULT = '0x80070005'.
hi, i am trying to execute the below query and i getting error as HRESULT = '0x80070005'.: I have given "Storage Blob Data Contributor" access to synapse analytics resource. can anyone help me?. CREATE EXTERNAL TABLE…
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
SharePoint linked service input is not a valid Base-64
Hello Team, We are trying to connect to a sharePoint list, when testing connection we are getting the below error message: The input is not a valid Base-64 string as it contains a non-base 64 character, more than two padding characters, or an illegal…
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
sftp (restricted) from a pyspark notebook
Hello I need to access an sftp site from a pyspark notebook, however, this site is restricted and can be only accessed from a previously identifed IP address (whitelist) Is this posible? Thanks for your help
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Synapse Workspace Notebooks - Upload files to sparkpools for google api credentials
I am working with Synapse Workspace Notebooks to import information from google API's. I need to upload credential files to the local directories on the synapse spark pools, I have not been able to figure out how to do that Uploading to azure storage…
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
synapse pyspark write dataframe to sql azure
I want to use Pyspark datawrite.write method to write dataframe to sql azure database with linked service. How can I achieve it?
Azure SQL Database
An Azure relational database service.
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.