Myths, Mistakes, and Lessons learned about Managing SQL Server databases. We also focus on automating and validating your critical database management tasks.
Report
Share
Report
Share
1 of 30
Download to read offline
More Related Content
Similar to Database Management Myths for Developers
This document provides a summary of Periasamy Rasu's experience as an MSSQL Server DBA and Developer. He has over 6 years of experience administering and developing databases in MSSQL 2008, 2008 R2, 2012, and 2014. His skills include database maintenance, performance tuning, high availability solutions, replication, and troubleshooting SQL issues. He has worked on projects for clients such as SingTel, Daikin, and BestBuy, taking on roles like database administrator and programmer.
Periasamy Rasu has over 6 years of experience as an MSSQL Server DBA and developer. He has experience with SQL Server 2008, 2008 R2, 2012, and 2014, including performance tuning, database maintenance, and troubleshooting. He provides database administration and support for various clients in Singapore, including SingTel, Daikin, and BestBuy. His technical skills include SQL Server, SSIS, SSRS, and C#.
Sandeep Raj Kosuri has over 7 years of experience as a SQL Server database administrator. He has a Bachelor's degree in Electrical and Electronics Engineering and is proficient in SQL Server, Microsoft Office, and various operating systems. He currently works as a SQL Server DBA at InfoGrid Technologies, where his responsibilities include database administration, performance monitoring and optimization, backup and recovery, and security management. Previously he has worked as a SQL Server DBA for two other companies, where he performed tasks such as database maintenance, upgrades, replication, and disaster recovery planning.
The document provides a summary of a candidate's career objective, professional experience, qualifications, and skills as a SQL database administrator. Specifically:
- The candidate has over 2 years of experience as a SQL DBA providing high availability and security for production, QA, and test databases in the airline industry.
- Their experience includes database installation, configuration, backup and recovery, security, and performance monitoring and optimization.
- Education includes a Master's degree in Computer Application from 2014 and Bachelor's degree from 2011, and Microsoft SQL Server certification.
- Current role is as an Associate SQL DBA with NIIT Technologies since 2014, working on the Airport Operation Control Center project for the Airport Authority of India.
This document discusses database deployment automation. It begins with introductions and an example of a problematic Friday deployment. It then reviews the concept of automation and different visions of it within an organization. Potential tools and frameworks for automation are discussed, along with common pitfalls. Basic deployment workflows using Oracle Cloud Control are demonstrated, including setting credentials, creating a proxy user, adding target properties, and using a job template. The document concludes by emphasizing that database deployment automation is possible but requires effort from multiple teams.
Red Rock Consulting is an Australian IT services company focused on providing solutions using Microsoft SQL Server and Oracle technologies. They have developed RockSolid, an automated database management product that uses virtualization and automation to provide consistent high service levels for SQL Server instances. RockSolid monitors databases, analyzes issues, resolves problems automatically using predefined processes, and provides capacity planning to reduce management costs and improve support.
Chetan Kumar has over 5 years of experience as a SQL Server DBA. He has extensive experience installing, configuring, and administering Microsoft SQL Server databases. Some of his responsibilities include database backups, performance tuning, high availability configurations, troubleshooting issues, and providing 24/7 production support. He is currently working as a SQL Server DBA for Misys managing their SQL Server infrastructure.
ECMDay2015 - Kent Agerlund – Configuration Manager 2012 – A Site ReviewKenny Buntinx
Ever experienced sluggish ConfigMgr administrator console performance or collections taking forever to refresh? Join Kent Agerlund as he will walk you thru a ConfigMgr site review and reveal why so many ConfigMgr installations don’t perform as they should. This sessions will be packed with tip and tricks, SQL secrets and PowerShell scripts that will optimize your environment and bring ConfigMgr into the state it was supposed to be from the beginning
The document is a resume for Prashanth Kumar Dasa. It summarizes his experience as a SQL Database Administrator over 4 years, including 10 months at Tata Consultancy Services and 3.2 years at AT&T. It lists his technical skills like SQL Server 2005/2008/2012 administration, high availability configurations, backup procedures and T-SQL programming. It also provides details of his most recent roles as a SQL DBA for Advanced Micro Devices and AT&T, responsibilities included database maintenance, upgrades, backups, performance monitoring and more.
This document contains instructions and summaries for assignments in the DBM 380 course. It includes assignments related to database recommendations, normalized database design, creating and populating databases, querying and updating related tables, and taking on the role of a database administrator. The course also includes weekly discussion questions and individual/team assignments involving database concepts.
This document contains instructions and summaries for assignments in the DBM 380 course. It includes assignments related to database recommendations, normalized database design, creating and populating databases, querying and updating related tables, and assuming the role of a database administrator. The course also includes weekly discussion questions and individual/team assignments involving database concepts.
Sanyog Singh is a SQL Server Database Administrator with over 9 years of experience managing databases, performing tuning and maintenance, and providing support. He has worked for several large companies and has certifications in SQL Server, ITIL, and other areas. The document provides details on his skills, experience, education, and accomplishments in database administration and management.
SQL Analytics Powering Telemetry Analysis at ComcastDatabricks
Comcast is one of the leading providers of communications, entertainment, and cable products and services. At the heart of it is Comcast RDK providing the backbone of telemetry to the industry. RDK (Reference Design Kit) is pre-bundled opensource firmware for a complete home platform covering video, broadband and IoT devices. RDK team at Comcast analyzes petabytes of data, collected every 15 minutes from 70 million devices (video and broadband and IoT devices) installed in customer homes. They run ETL and aggregation pipelines and publish analytical dashboards on a daily basis to reduce customer calls and firmware rollout. The analysis is also used to calculate WIFI happiness index which is a critical KPI for Comcast customer experience.
In addition to this, RDK team also does release tracking by analyzing the RDK firmware quality. SQL Analytics allows customers to operate a lakehouse architecture that provides data warehousing performance at data lake economics for up to 4x better price/performance for SQL workloads than traditional cloud data warehouses.
We present the results of the “Test and Learn” with SQL Analytics and the delta engine that we worked in partnership with the Databricks team. We present a quick demo introducing the SQL native interface, the challenges we faced with migration, The results of the execution and our journey of productionizing this at scale.
Pradeep G P is a Senior SQL Database Administrator with over 6 years of experience in handling SQL databases. He has extensive experience designing, maintaining, and tuning SQL Server databases. He has worked on databases ranging from SQL Server 2000 to SQL Server 2012 in both clustered and non-clustered environments. Pradeep is proficient in database administration tasks including backups, security management, performance tuning and high availability solutions.
The document discusses several high availability and disaster recovery options for SQL Server including failover clustering, database mirroring, log shipping, and replication. It provides examples of how different companies have implemented these technologies depending on their requirements. Key factors that influence architecture choices are downtime tolerance, deployment of technologies, and operational procedures. The document also covers SQL Server upgrade processes and how to move databases to a new datacenter while maintaining high availability.
DBA Basics: Getting Started with Performance Tuning.pdfJohn Sterrett
Have you ever found yourself in need of making queries go faster but didn't know where to begin? In this session, you will learn multiple ways to find your top offending statements. You will learn three key tips to help you understand execution plans. Finally, you will learn a framework to help you create indexes to help performance.
Workload Replay in the Cloud: Secret Weapon for Cloud MigrationsJohn Sterrett
Want to save money, validate performance, and make sure you don't have errors while migrating to the cloud? Video can be watched @ https://procuresql.com/blog/2020/09/11/replay-in-the-cloud/
This document discusses using PowerPivot for database administration tasks like performance analysis. It provides an overview of the typical performance tuning process including generating workloads, capturing data, analyzing the captured data, and making changes. Specific data used for health checks is discussed, including wait statistics, disk latency, performance counters, and SQL traces. Examples are given of analyzing this data in PowerPivot to help tell the story of a server's performance to customers in real time. A demonstration of connecting PowerPivot to SQL Server and using filters, slicers, and charts for wait stats, disk latency, and performance counter analysis is highlighted.
Introduction to High Availability with SQL ServerJohn Sterrett
Have you ever wondered how companies keep their databases online through unplanned disasters? Have you wondered which high availability features might be best for our shop? In this session we will go over a quick look at log shipping, database mirroring, transactional replication, failover cluster instances and availability groups. John will identify pros and cons for each features and share some tips from the field.
This document provides an introduction to using PowerShell for database administrators (DBAs). It outlines the objectives of covering PowerShell basics and examples for DBAs. It then defines some key PowerShell concepts like cmdlets, special variables, data types, operators, looping, and comparisons. The document concludes with a call to action to get started with PowerShell.
SQL Server Performance Root Cause Analysis in 10 MinutesJohn Sterrett
This document discusses a presentation by John Sterrett on SQL Server performance root cause analysis. The presentation covers identifying bottlenecks like memory, disk, CPU and locking issues that can cause SQL Server performance problems. It also discusses scripts available from Sterrett's website that can help analyze what is running on SQL Server, historical performance issues and if storage could be slowing things down. The presentation aims to help administrators troubleshoot SQL Server performance issues in 10 minutes.
Table Partitioning: Secret Weapon for Big Data ProblemsJohn Sterrett
Table partitioning allows administrators to divide large tables into smaller, more manageable partitions. This allows maintenance tasks like backups, index rebuilds and statistics updates to be performed on individual partitions rather than entire tables. It also improves query performance by allowing the optimizer to eliminate partitions that are not needed to satisfy a query. A sliding window technique uses partition splits and merges to automate moving old data into archive partitions with minimal data movement, improving purging and archiving processes.
Introduction to execution plan analysisJohn Sterrett
This document provides an introduction to execution plan analysis for performance tuning. It discusses dividing performance tuning into separate areas like hardware, disk performance, and other applications. It then focuses on execution plans, index operations like scans and seeks, join operations like hash and nested loop joins, and parallelism. The objectives are to understand additional execution plan tools, index best practices, join types, and when parallelism is beneficial or not.
The document outlines a 12 step process for workload tuning to improve database performance. The steps include capturing the production workload, analyzing it to identify potential changes, restoring backups to a test server, replaying the workload to establish a baseline, making tuning changes on the test server, and re-capturing the workload on test to validate performance improvements before implementing changes in production. The goal is to safely tune database workloads by testing changes on a test server first without impacting the production environment.
This document provides an overview of performance tuning for SQL Server databases. It discusses eliminating obvious issues, understanding common bottlenecks like CPU, memory, disk and locking, and using tools like wait statistics, performance counters and dynamic management views to analyze workload and identify tuning opportunities. The document outlines a 12 step process for capturing a production workload, replaying it on a test server, making tuning changes and reanalyzing. It also demonstrates various tools and techniques like SQL Profiler, SQL Diagnostic Manager and RML Utilities.
John Sterrett discusses hosting a SQL Saturday event. As the founder and host of SQL Saturday events #36 and #80 in Wheeling, WV, he shares tips for organizing a successful event including finding a cheap facility, forming an organizing team, partnering with other organizations, and attending sessions yourself. He emphasizes marketing the event to local SQL and .NET user groups as well as companies and using social media. Budgeting involves fundraising from sponsors and tracking money raised versus spent. Help is available from PASS Headquarters, regional mentors, sponsors, and others who have organized previous SQL Saturdays.
Evaluating Daily Checklist Against 1000 Servers using Policy Based ManagementJohn Sterrett
This document discusses using Policy Based Management (PBM) and Central Management Server (CMS) to automate and evaluate a daily SQL Server checklist. It recommends creating policies in PBM to validate checklist items like SQL Agent jobs succeeded and backups completed successfully. The policies can run on a schedule or when changes are detected. CMS allows applying policies or scripts to multiple servers grouped by environment. The presenter demonstrates importing policies into PBM and evaluating them to automatically check the daily checklist.
This document summarizes a session on SQL Server 2008 for developers. The session will cover Management Studio enhancements, T-SQL features like filtered indexes and table-valued parameters, new date/time data types, the MERGE statement, policy-based management, and change data capture. Demo portions of the session will showcase features like the debugger, filtered indexes, table-valued parameters, and change data capture. The presenter is a SQL Server developer and DBA from Wheeling, WV who writes about SQL Server.
Evaluate Daily Checklist with PBM and CMSJohn Sterrett
This presentation gives an introduction to evaluating a daily checklist against 100+ instances of SQL Server while you get a cup of coffee. It will be given at SQLRally 2011
Transcript: Details of description part II: Describing images in practice - T...BookNet Canada
This presentation explores the practical application of image description techniques. Familiar guidelines will be demonstrated in practice, and descriptions will be developed “live”! If you have learned a lot about the theory of image description techniques but want to feel more confident putting them into practice, this is the presentation for you. There will be useful, actionable information for everyone, whether you are working with authors, colleagues, alone, or leveraging AI as a collaborator.
Link to presentation recording and slides: https://bnctechforum.ca/sessions/details-of-description-part-ii-describing-images-in-practice/
Presented by BookNet Canada on June 25, 2024, with support from the Department of Canadian Heritage.
Quantum Communications Q&A with Gemini LLM. These are based on Shannon's Noisy channel Theorem and offers how the classical theory applies to the quantum world.
7 Most Powerful Solar Storms in the History of Earth.pdfEnterprise Wired
Solar Storms (Geo Magnetic Storms) are the motion of accelerated charged particles in the solar environment with high velocities due to the coronal mass ejection (CME).
In this follow-up session on knowledge and prompt engineering, we will explore structured prompting, chain of thought prompting, iterative prompting, prompt optimization, emotional language prompts, and the inclusion of user signals and industry-specific data to enhance LLM performance.
Join EIS Founder & CEO Seth Earley and special guest Nick Usborne, Copywriter, Trainer, and Speaker, as they delve into these methodologies to improve AI-driven knowledge processes for employees and customers alike.
Video traffic on the Internet is constantly growing; networked multimedia applications consume a predominant share of the available Internet bandwidth. A major technical breakthrough and enabler in multimedia systems research and of industrial networked multimedia services certainly was the HTTP Adaptive Streaming (HAS) technique. This resulted in the standardization of MPEG Dynamic Adaptive Streaming over HTTP (MPEG-DASH) which, together with HTTP Live Streaming (HLS), is widely used for multimedia delivery in today’s networks. Existing challenges in multimedia systems research deal with the trade-off between (i) the ever-increasing content complexity, (ii) various requirements with respect to time (most importantly, latency), and (iii) quality of experience (QoE). Optimizing towards one aspect usually negatively impacts at least one of the other two aspects if not both. This situation sets the stage for our research work in the ATHENA Christian Doppler (CD) Laboratory (Adaptive Streaming over HTTP and Emerging Networked Multimedia Services; https://athena.itec.aau.at/), jointly funded by public sources and industry. In this talk, we will present selected novel approaches and research results of the first year of the ATHENA CD Lab’s operation. We will highlight HAS-related research on (i) multimedia content provisioning (machine learning for video encoding); (ii) multimedia content delivery (support of edge processing and virtualized network functions for video networking); (iii) multimedia content consumption and end-to-end aspects (player-triggered segment retransmissions to improve video playout quality); and (iv) novel QoE investigations (adaptive point cloud streaming). We will also put the work into the context of international multimedia systems research.
Are you interested in learning about creating an attractive website? Here it is! Take part in the challenge that will broaden your knowledge about creating cool websites! Don't miss this opportunity, only in "Redesign Challenge"!
The DealBook is our annual overview of the Ukrainian tech investment industry. This edition comprehensively covers the full year 2023 and the first deals of 2024.
AC Atlassian Coimbatore Session Slides( 22/06/2024)apoorva2579
This is the combined Sessions of ACE Atlassian Coimbatore event happened on 22nd June 2024
The session order is as follows:
1.AI and future of help desk by Rajesh Shanmugam
2. Harnessing the power of GenAI for your business by Siddharth
3. Fallacies of GenAI by Raju Kandaswamy
Kief Morris rethinks the infrastructure code delivery lifecycle, advocating for a shift towards composable infrastructure systems. We should shift to designing around deployable components rather than code modules, use more useful levels of abstraction, and drive design and deployment from applications rather than bottom-up, monolithic architecture and delivery.
UiPath Community Day Kraków: Devs4Devs ConferenceUiPathCommunity
We are honored to launch and host this event for our UiPath Polish Community, with the help of our partners - Proservartner!
We certainly hope we have managed to spike your interest in the subjects to be presented and the incredible networking opportunities at hand, too!
Check out our proposed agenda below 👇👇
08:30 ☕ Welcome coffee (30')
09:00 Opening note/ Intro to UiPath Community (10')
Cristina Vidu, Global Manager, Marketing Community @UiPath
Dawid Kot, Digital Transformation Lead @Proservartner
09:10 Cloud migration - Proservartner & DOVISTA case study (30')
Marcin Drozdowski, Automation CoE Manager @DOVISTA
Pawel Kamiński, RPA developer @DOVISTA
Mikolaj Zielinski, UiPath MVP, Senior Solutions Engineer @Proservartner
09:40 From bottlenecks to breakthroughs: Citizen Development in action (25')
Pawel Poplawski, Director, Improvement and Automation @McCormick & Company
Michał Cieślak, Senior Manager, Automation Programs @McCormick & Company
10:05 Next-level bots: API integration in UiPath Studio (30')
Mikolaj Zielinski, UiPath MVP, Senior Solutions Engineer @Proservartner
10:35 ☕ Coffee Break (15')
10:50 Document Understanding with my RPA Companion (45')
Ewa Gruszka, Enterprise Sales Specialist, AI & ML @UiPath
11:35 Power up your Robots: GenAI and GPT in REFramework (45')
Krzysztof Karaszewski, Global RPA Product Manager
12:20 🍕 Lunch Break (1hr)
13:20 From Concept to Quality: UiPath Test Suite for AI-powered Knowledge Bots (30')
Kamil Miśko, UiPath MVP, Senior RPA Developer @Zurich Insurance
13:50 Communications Mining - focus on AI capabilities (30')
Thomasz Wierzbicki, Business Analyst @Office Samurai
14:20 Polish MVP panel: Insights on MVP award achievements and career profiling
How RPA Help in the Transportation and Logistics Industry.pptxSynapseIndia
Revolutionize your transportation processes with our cutting-edge RPA software. Automate repetitive tasks, reduce costs, and enhance efficiency in the logistics sector with our advanced solutions.
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - MydbopsMydbops
This presentation, delivered at the Postgres Bangalore (PGBLR) Meetup-2 on June 29th, 2024, dives deep into connection pooling for PostgreSQL databases. Aakash M, a PostgreSQL Tech Lead at Mydbops, explores the challenges of managing numerous connections and explains how connection pooling optimizes performance and resource utilization.
Key Takeaways:
* Understand why connection pooling is essential for high-traffic applications
* Explore various connection poolers available for PostgreSQL, including pgbouncer
* Learn the configuration options and functionalities of pgbouncer
* Discover best practices for monitoring and troubleshooting connection pooling setups
* Gain insights into real-world use cases and considerations for production environments
This presentation is ideal for:
* Database administrators (DBAs)
* Developers working with PostgreSQL
* DevOps engineers
* Anyone interested in optimizing PostgreSQL performance
Contact info@mydbops.com for PostgreSQL Managed, Consulting and Remote DBA Services
Coordinate Systems in FME 101 - Webinar SlidesSafe Software
If you’ve ever had to analyze a map or GPS data, chances are you’ve encountered and even worked with coordinate systems. As historical data continually updates through GPS, understanding coordinate systems is increasingly crucial. However, not everyone knows why they exist or how to effectively use them for data-driven insights.
During this webinar, you’ll learn exactly what coordinate systems are and how you can use FME to maintain and transform your data’s coordinate systems in an easy-to-digest way, accurately representing the geographical space that it exists within. During this webinar, you will have the chance to:
- Enhance Your Understanding: Gain a clear overview of what coordinate systems are and their value
- Learn Practical Applications: Why we need datams and projections, plus units between coordinate systems
- Maximize with FME: Understand how FME handles coordinate systems, including a brief summary of the 3 main reprojectors
- Custom Coordinate Systems: Learn how to work with FME and coordinate systems beyond what is natively supported
- Look Ahead: Gain insights into where FME is headed with coordinate systems in the future
Don’t miss the opportunity to improve the value you receive from your coordinate system data, ultimately allowing you to streamline your data analysis and maximize your time. See you there!
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/07/intels-approach-to-operationalizing-ai-in-the-manufacturing-sector-a-presentation-from-intel/
Tara Thimmanaik, AI Systems and Solutions Architect at Intel, presents the “Intel’s Approach to Operationalizing AI in the Manufacturing Sector,” tutorial at the May 2024 Embedded Vision Summit.
AI at the edge is powering a revolution in industrial IoT, from real-time processing and analytics that drive greater efficiency and learning to predictive maintenance. Intel is focused on developing tools and assets to help domain experts operationalize AI-based solutions in their fields of expertise.
In this talk, Thimmanaik explains how Intel’s software platforms simplify labor-intensive data upload, labeling, training, model optimization and retraining tasks. She shows how domain experts can quickly build vision models for a wide range of processes—detecting defective parts on a production line, reducing downtime on the factory floor, automating inventory management and other digitization and automation projects. And she introduces Intel-provided edge computing assets that empower faster localized insights and decisions, improving labor productivity through easy-to-use AI tools that democratize AI.
2. About Kon and John @ ProcureSQL
2
kon@procuresql.com
procuresql.com
linkedin.com/in/konmelamud
john@procuresql.com
@johnsterrett
johnsterrett.com
procuresql.com/blog
linkedin.com/in/johnsterrett
5. Direct Access to
Data/Application
Architects and DBAs
• Senior Data Architects are demanding
salaries over 200k per year.
• We provide customized plans to fit your
needs
• Plans start at 4k/month
• Includes
• Architecture
• Training and Mentoring
• Projects
• Reporting
• Implementation
• Support
6. Today’s Agenda
Myths of Database Management
Common Mistakes and Lessons Learned
Automate and Validate Important Stuff…
** NOTE: We will focus on SQL Server Database Engine, but everything today
applies to relational database engines. ***
7. Common Mistakes and Lessons
Lessons
•Disaster planning…(?)
•Manned Disasters
•Unmanned/HW
disasters
•Natural Disasters
Mistakes (?)
•ASSUME…
14. Are you utilizing the Query Store?
DBA Basics: Getting Started with Performance Tuning - SQL Server Consulting &
Remote DBA Service (johnsterrett.com)
22. Critical Care SQL Maintenance
• Backups
• Integrity Checks
• Index and Statistics
• Disk Usage
• Error Log Management
• Jobs and Processes
Photo Credit
23. The Gold Standard SQL Server for
Database Maintenance Tasks
dbatools docs | Install-DbaMaintenanceSolution
25. Testing for Restores and Corruption….
Test-DbaLastBackup -SqlInstance ProdSQL01 -Destination TestSQL01
Restores all or some of the latest backups and performs a DBCC CHECKDB.
Gathers information about the last full backups
Restores the backups to the Destination with a new name. If no Destination is specified, the originating SQL Server instance
will be used.
The database is restored as "dbatools-testrestore-$databaseName" by default, but you can change dbatools-testrestore to
whatever you would like using -Prefix
The internal file names are also renamed to prevent conflicts with original database
A DBCC CHECKDB is then performed
And the test database is finally dropped
dbatools docs | Test-DbaLastBackup
29. Do Not Reinvent the Wheel
• Dbatools.io – Powershell automation for SQL Server
• Ola Hallengren Maintenance Solution
• Built in Features like Query Store, Central Management Studio,
Policy-Based Management
30. Procure Your Data Service Provider!
Service Details – Packages start as low as 4k
per month
• US-Based Resources only.
• Primary Data Architect and access to our
team of Experts for anything data related.
• Ability to help with training, architecture,
projects, and reporting at the same rate