Skip to content

Commit

Permalink
Merge pull request #13017 from MicrosoftDocs/learn-build-service-prod…
Browse files Browse the repository at this point in the history
…bot/docutune-autopr-20240923-050603-2395775-ignore-build

[DocuTune-Remediation] - Scheduled execution to fix known issues in Azure Architecture Center articles (part 2)
  • Loading branch information
prmerger-automator[bot] authored Sep 23, 2024
2 parents 60193ea + 59d9a65 commit a6149d7
Show file tree
Hide file tree
Showing 7 changed files with 55 additions and 60 deletions.
24 changes: 11 additions & 13 deletions docs/ai-ml/openai/architecture/log-monitor-azure-openai-content.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ This solution provides comprehensive logging and monitoring and enhanced securit
2. Azure Application Gateway provides a single point of entry for clients to the private network that contains the Azure OpenAI models and APIs. For internal applications the gateway also enables hybrid access from cross-premises clients.
- Application Gateway Web Application Firewall (WAF) provides protection against common web vulnerabilities and exploits.
- Application Gateway health probes are used to monitor health of the APIs.

> [!NOTE]
> Load balancing of stateful operations like model fine-tuning, deployments, and inference of fine-tuned models isn't supported.
Expand All @@ -22,25 +22,25 @@ This solution provides comprehensive logging and monitoring and enhanced securit
- Monitoring provides detailed Azure OpenAI model usage, key performance indicators (KPIs), and metrics, including prompt information and token statistics for usage traceability.
4. API Management connects to all origin resources via Azure Private Link. This configuration provides enhanced privacy for all traffic by containing traffic in the private network.
5. This topology also supports [multiple Azure OpenAI instances](/azure/architecture/ai-ml/guide/azure-openai-gateway-multi-backend) to enable scale-out of API usage to ensure high availability and disaster recovery for the service.
6. For Azure OpenAI model inputs and outputs that exceed the default logging capabilities, APIM policies forward requests to Azure Event Hubs and Azure Stream Analytics to extract payload information and store in Azure Data Storage service such as Azure SQL DB or Azure Data Explorer. This enables capture of specific data for compliance and auditing purposes without any limits on payload sizing and minimal performance impacts.
6. For Azure OpenAI model inputs and outputs that exceed the default logging capabilities, APIM policies forward requests to Azure Event Hubs and Azure Stream Analytics to extract payload information and store in Azure Data Storage service such as Azure SQL DB or Azure Data Explorer. This enables capture of specific data for compliance and auditing purposes without any limits on payload sizing and minimal performance impacts.

> [!NOTE]
> For streaming responses with Azure OpenAI models, additional configuration is required to capture model completions. This configuration is not covered in this architecture.
### Components

- [Application Gateway](https://azure.microsoft.com/services/application-gateway/). Application load balancer to help ensure that all users of the Azure OpenAI APIs get the fastest response and highest throughput for model completions. The Application Gateway also provides a Web Application Firewall (WAF) to protect against common web vulnerabilities and exploits.
- [Application Gateway](https://azure.microsoft.com/services/application-gateway/). Application load balancer to help ensure that all users of the Azure OpenAI APIs get the fastest response and highest throughput for model completions. The application gateway also provides a Web Application Firewall (WAF) to protect against common web vulnerabilities and exploits.
- [API Management](https://azure.microsoft.com/services/api-management/). API management platform for accessing back-end Azure OpenAI endpoints. Provides monitoring and logging that's not available natively in Azure OpenAI. API Management also provides monitoring, logging, and managed access to Azure OpenAI resources.
- [Azure Virtual Network](https://azure.microsoft.com/services/virtual-network/). Private network infrastructure in the cloud. Provides network isolation so that all network traffic for models is routed privately to Azure OpenAI. In this architecture, the Virtual Network provides network isolation for all deployed Azure resources.
- [Azure OpenAI](https://azure.microsoft.com/products/ai-services/openai-service/). Service that hosts models and provides generative model completion outputs. Azure OpenAI provides access to the GPT Large Language Models used by end-user.
- [Monitor](https://azure.microsoft.com/services/monitor/). End-to-end observability for applications. Provides access to application logs via Kusto Query Language. Also enables dashboard reports and monitoring and alerting capabilities. In this architecture, Monitor provides access to API Management logs and metrics.
- [Azure Key Vault](https://azure.microsoft.com/services/key-vault/). Enhanced-security storage for keys and secrets that are used by applications. Key Vault provides secure storage for all resource secrets.
- [Azure Storage](https://azure.microsoft.com/services/storage/). Application storage in the cloud. Provides Azure OpenAI with accessibility to model training artifacts. Azure Storage provides persistence of AOAI managed artifacts.
- [Azure Virtual Network](https://azure.microsoft.com/services/virtual-network/). Private network infrastructure in the cloud. Provides network isolation so that all network traffic for models is routed privately to Azure OpenAI. In this architecture, the virtual network provides network isolation for all deployed Azure resources.
- [Azure OpenAI](https://azure.microsoft.com/products/ai-services/openai-service/). Service that hosts models and provides generative model completion outputs. Azure OpenAI provides access to the GPT Large Language Models used by end-user.
- [Monitor](https://azure.microsoft.com/services/monitor/). End-to-end observability for applications. Provides access to application logs via Kusto Query Language. Also enables dashboard reports and monitoring and alerting capabilities. In this architecture, Monitor provides access to API Management logs and metrics.
- [Azure Key Vault](https://azure.microsoft.com/services/key-vault/). Enhanced-security storage for keys and secrets that are used by applications. Key Vault provides secure storage for all resource secrets.
- [Azure Storage](https://azure.microsoft.com/services/storage/). Application storage in the cloud. Provides Azure OpenAI with accessibility to model training artifacts. Azure Storage provides persistence of AOAI managed artifacts.
- [Azure Event Hub](https://azure.microsoft.com/services/event-hubs/). Event ingestion service that can receive and process events from applications and services. Event Hub provides a scalable event ingestion service for streaming AOAI model completions.
- [Azure Stream Analytics](https://azure.microsoft.com/services/stream-analytics/). Real-time data stream processing from Azure Event Hub. Stream Analytics provides real-time processing of steam messages.
- [Azure Data Explorer](https://azure.microsoft.com/services/data-explorer/). Fast and highly scalable data exploration service for log and telemetry data. Data Explorer can be used to store all logged conversations which are sent in streaming mode from the LLM.
- [Azure Data Explorer](https://azure.microsoft.com/services/data-explorer/). Fast and highly scalable data exploration service for log and telemetry data. Azure Data Explorer can be used to store all logged conversations which are sent in streaming mode from the LLM.
- [Azure SQL Database](https://azure.microsoft.com/services/sql-database/). Managed relational database service that provides a secure, scalable database for storing structured data. Azure SQL DB can be used to store all logged conversations which are sent in streaming mode from the LLM.
- [Microsoft Entra ID](https://azure.microsoft.com/services/active-directory/). Enables user authentication and authorization to the application and to platform services that support the application. Microsoft Entra ID provides secure access to all Azure resources which includes using identity based access control.
- [Microsoft Entra ID](https://azure.microsoft.com/services/active-directory/). Enables user authentication and authorization to the application and to platform services that support the application. Microsoft Entra ID provides secure access to all Azure resources which includes using identity based access control.

### Alternatives

Expand Down Expand Up @@ -69,7 +69,6 @@ The following table provides a comparison of the metrics provided by the default
|Assistants API operations |x | x|
|Assistants API prompt detail | | x|


## Scenario details

Large enterprises that use generative AI models need to implement auditing and logging of the use of these models to ensure responsible use and corporate compliance. This solution provides enterprise-level logging and monitoring for all interactions with AI models to mitigate harmful use of the models and help ensure that security and compliance standards are met. The solution integrates with existing APIs for Azure OpenAI with little modification to take advantage of existing code bases. Administrators can also monitor service usage for reporting.
Expand Down Expand Up @@ -172,7 +171,6 @@ Other contributors:
- [Azure-Samples/openai-python-enterprise-logging (GitHub)](https://github.com/Azure-Samples/openai-python-enterprise-logging)
- [Configure Azure AI Services virtual networks](/azure/ai-services/cognitive-services-virtual-networks)


## Related resources
- [Azure OpenAI: Documentation, quickstarts, API reference](/azure/ai-services/openai/)
- [Protect APIs with Azure Application Gateway and Azure API Management](../../../web-apps/api-management/architectures/protect-apis.yml)
Expand Down
2 changes: 1 addition & 1 deletion docs/aws-professional/eks-to-aks/storage.md
Original file line number Diff line number Diff line change
Expand Up @@ -181,7 +181,7 @@ For more information, see:

Like Amazon EKS, AKS is a Kubernetes implementation, and you can integrate third-party Kubernetes storage solutions. Here are some examples of third-party storage solutions for Kubernetes:

- [Rook](https://rook.io/) turns distributed storage systems into self-managing storage services by automating storage administrator tasks. Rook delivers its services via a Kubernetes operator for each storage provider.
- [Rook](https://rook.io/) turns distributed storage systems into self-managing storage services by automating Storage administrator tasks. Rook delivers its services via a Kubernetes operator for each storage provider.
- [GlusterFS](https://www.gluster.org/) is a free and open-source scalable network filesystem that uses common off-the-shelf hardware to create large, distributed storage solutions for data-heavy and bandwidth-intensive tasks.
- [Ceph](https://www.ceph.com/en/) provides a reliable and scalable unified storage service with object, block, and file interfaces from a single cluster built from commodity hardware components.
- [MinIO](https://min.io/) multicloud object storage lets enterprises build AWS S3-compatible data infrastructure on any cloud, providing a consistent, portable interface to your data and applications.
Expand Down
2 changes: 1 addition & 1 deletion docs/aws-professional/services.md
Original file line number Diff line number Diff line change
Expand Up @@ -167,7 +167,7 @@ For an overview of Azure for AWS users, see [Introduction to Azure for AWS profe
| [Developer Tools](https://aws.amazon.com/products/developer-tools) | [Developer Tools](https://azure.microsoft.com/services/devops/) | Collection of tools for building, debugging, deploying, diagnosing, and managing multiplatform scalable apps and services. |
| [CodeBuild](https://aws.amazon.com/codebuild) | [DevOps Pipeline](https://azure.microsoft.com/services/devops/pipelines) <br/><br/> [GitHub Actions](https://github.com/features/actions) | Fully managed build service that supports continuous integration and continuous deployment (CI/CD). |
| [Command-line interface](https://aws.amazon.com/cli) | [CLI](/cli/azure/install-azure-cli) <br/><br/>[PowerShell](/powershell/azure/overview) | Built on top of the native REST API across all cloud services, various programming language-specific wrappers provide easier ways to create solutions. |
| [`eksctl`](https://docs.aws.amazon.com/eks/latest/userguide/getting-started-eksctl.html) | [`az aks`](/cli/azure/aks) | Manage Azure Kubernetes Service (AKS) using these Azure CLI commands. |
| [`eksctl`](https://docs.aws.amazon.com/eks/latest/userguide/getting-started-eksctl.html) | [`az aks` command group](/cli/azure/aks) | Manage Azure Kubernetes Service (AKS) using these Azure CLI commands. |
| [AWS CloudShell](https://aws.amazon.com/cloudshell) | [Azure Cloud Shell](/azure/cloud-shell/overview) | Azure Cloud Shell is an interactive, authenticated, browser-accessible shell for managing Azure resources. It gives you the flexibility to choose the shell experience that best suits the way you work, either Bash or PowerShell. |
| [OpsWorks (Chef-based)](https://aws.amazon.com/opsworks) | [Automation](https://azure.microsoft.com/services/automation) | Configures and operates applications of all shapes and sizes, and provides templates to create and manage a collection of resources. |
| [CloudFormation](https://aws.amazon.com/cloudformation) | [Resource Manager](https://azure.microsoft.com/features/resource-manager) <br/><br/>[Bicep](/azure/azure-resource-manager/bicep/overview) <br/><br/>[VM extensions](/azure/virtual-machines/extensions/features-windows) <br/><br/>[Azure Automation](https://azure.microsoft.com/services/automation) | Provides a way for users to automate the manual, long-running, error-prone, and frequently repeated IT tasks.
Expand Down
2 changes: 1 addition & 1 deletion docs/data-guide/scenarios/data-transfer.md
Original file line number Diff line number Diff line change
Expand Up @@ -128,7 +128,7 @@ The following tables summarize the key differences in capabilities.

**Other:**

| Capability | Azure CLI | AzCopy | PowerShell | AdlCopy | PolyBase |
| Capability | The Azure CLI | AzCopy | PowerShell | AdlCopy | PolyBase |
| --- | --- | --- | --- | --- | --- |
| Compatible platforms | Linux, OS X, Windows | Linux, Windows | Windows | Linux, OS X, Windows | SQL Server, Azure Synapse Analytics |
| Optimized for big data | No | Yes | No | Yes <sup>1</sup> | Yes <sup>2</sup> |
Expand Down
Loading

0 comments on commit a6149d7

Please sign in to comment.