by Sujit D'Mello
August 15, 2024
Azure Open AI is widely used in industry but there are number of security aspects that must be taken into account when using the technology. Luckily for us, Audrey Long, a Software Engineer at Microsoft, security expert and renowned conference speaker, gives us insights into securing LLMs and provides various tips, tricks and tools to help developers use these models safely in their applications.
![](./?url=aHR0cHM6Ly9henBvZGNhc3QuYXp1cmV3ZWJzaXRlcy5uZXQvaW1hZ2UuYXhkP3BpY3R1cmU9JTJmMjAyNCUyZjA4JTJmYXVkcmV5LmpwZw==&__proxy_form=0)
Media file: https://azpodcast.blob.core.windows.net/episodes/Episode502.mp3
YouTube: https://youtu.be/64Achcz97PI
Resources:
AI Tooling:
- Azure AI Tooling
- to detect and block prompt injection attacks, including a new model for identifying indirect prompt attacks before they impact your model, coming soon and now available in preview in Azure AI Content Safety.
- to detect “hallucinations” in model outputs, coming soon.
- to steer your model’s behavior toward safe, responsible outputs, coming soon.
- to assess an application’s vulnerability to jailbreak attacks and to generating content risks, now available in preview.
- to understand what model inputs, outputs, and end users are triggering content filters to inform mitigations, coming soon, and now available in preview in Azure OpenAI Service.
- AI Defender for Cloud
- AI Security Posture Management
- AI Workloads
- AI Red Teaming Tool
AI Development Considerations:
- AI Assessment from Microsoft
- Microsoft Responsible AI Processes
- Define Use Case and Model Architecture
- Content Filtering System
- Azure OpenAI Service includes a content filtering system that works alongside core models, including DALL-E image generation models.
- Additional classifiers are available for detecting jailbreak risks and known content for text and code.
- Red Teaming the LLM
- Create a Threat Model with OWASP Top 10
Other updates:
by Sujit D'Mello
August 1, 2024
by Sujit D'Mello
July 20, 2024
The team catches up with Daniel Taylor and Bradley Ball of the Azure Fast Track team and learns about how Database Watcher can help customers better manage and debug their Azure SQL, Elastic Pools, SQL Managed Instances, and Hyperscale and the replicas.
Daniel and Bradley also share the really cool work they are doing helping Azure customers learn about Azure with their Tales from the Field YouTube channel, plus we hear about some upcoming events where you can see Daniel and Bradley in person!!!
![](./?url=aHR0cHM6Ly9henBvZGNhc3QuYXp1cmV3ZWJzaXRlcy5uZXQvaW1hZ2UuYXhkP3BpY3R1cmU9JTJmMjAyNCUyZjA3JTJmYnJhZGxleWJhbGwuanBlZw==&__proxy_form=0)
Media file: https://azpodcast.blob.core.windows.net/episodes/Episode500.mp3
YouTube: https://youtu.be/Z_jBWLUBY9g
Resources:
https://learn.microsoft.com/en-us/azure/azure-sql/database-watcher-overview?view=azuresql
https://youtu.be/qr1Qxwao68M?si=mO24KZF3PAvTnnmn
Other updates:
https://azure.microsoft.com/en-us/updates/v2/Guest-OS-Family-Retirement
https://azure.microsoft.com/en-us/updates/v2/cmk-for-backup-vaults-ga/
https://azure.microsoft.com/en-us/updates/v2/Azure-Elastic-SAN-Feature-Updates
Azure classic resource providers will be retired on 31 August 2024 | Azure updates | Microsoft Azure
by Sujit D'Mello
July 12, 2024
by Sujit D'Mello
June 28, 2024
by Sujit D'Mello
June 15, 2024
Rishabh Tewari, a Software Engineer on the Azure team, gives us insights into Project Sirius. This is an upgrade to the Azure software that lights up Accelerated Connections for any resource that uses a network interface. Using a specialized SDN, customers and ISVs can achieve very high number of connections per second throughput across all of their Azure and non-Azure resources.
![](./?url=aHR0cHM6Ly9henBvZGNhc3QuYXp1cmV3ZWJzaXRlcy5uZXQvaW1hZ2UuYXhkP3BpY3R1cmU9JTJmMjAyNCUyZjA2JTJmcmlzaGFiaC5qcGVn&__proxy_form=0)
Media file: https://azpodcast.blob.core.windows.net/episodes/Episode497.mp3
YouTube: https://youtu.be/ZVgBBrRlZGQ
Resources:
https://www.usenix.org/system/files/nsdi23-bansal.pdf
Other updates:
https://azure.microsoft.com/en-us/updates/general-availability-audit-logging-in-azure-api-management-developer-portal/
https://learn.microsoft.com/en-us/azure/azure-monitor/logs/log-analytics-simple-mode
by Sujit D'Mello
June 6, 2024
by Sujit D'Mello
May 31, 2024
by Sujit D'Mello
May 23, 2024
by Sujit D'Mello
May 1, 2024
The team catches up with Priyanka Khare to learn about recent advancements in Azure Advisor and how customers can use Advisor to help ensure their workloads are more stable.
![](./?url=aHR0cHM6Ly9henBvZGNhc3QuYXp1cmV3ZWJzaXRlcy5uZXQvaW1hZ2UuYXhkP3BpY3R1cmU9JTJmMjAyNCUyZjA1JTJmcHJpeWFua2EucG5n&__proxy_form=0)
Media file: https://azpodcast.blob.core.windows.net/episodes/Episode493.mp3
YouTube: https://youtu.be/Y9LVYhSiGgE
Resources:
Azure Advisor: Advisor - Microsoft Azure
Advisor Workbooks: Advisor Workbooks
Advisor WAF Assessments: Advisor WAF Assessments
Advisor Recommendations: Advisor Recommendations
Advisor Manage Reviews: Advisor Manage Reviews
What's new on Azure Advisor: What's new in Azure Advisor - Azure Advisor | Microsoft Learn
Engage with Microsoft for a Resiliency Review: Azure Advisor resiliency reviews - Azure Advisor | Microsoft Learn