SQL Server Architecture: Pages and Extents


Logical Architecture: Pages and Extents

Pages:
  • Page is the fundamental unit of data storage in SQL Server (datablocks in Oracle).
  • Eight(8) physically contiguous pages => One (1) EXTENT.
  • Disk space allocated to a data file (.mdf or .ndf) in a database is logically divided into pages numbered from 0 to n.
  • Disk I/O operations are performed at the page level. (SQL Server reads/writes WHOLE pages).
  • Page size: 8kb. ==> 128 pages = 1Mb.

On SQL Server Pages

  • Header: 96-bytes. (page#, type, free space, allocation unit ID of the object that owns the page)
  • data rows: inserted serially in the page.

Types of Pages:
  • Data
  • Index
  • Text/Image
  • Global allocation Map: extent allocation info
  • Shared allocation Map: extent allocation info
  • Page Free Space: free space info
  • Index allocation map: extents used by table or index per allocation unit.
  • Bulk changed map: extents modified by BULK ops since last BACKUP LOG
  • Differential Changed Map: extents modified since last BACKTUP DATABASE

Extents
  • The basic unit of space management.
  • One EXTENT = EIGHT (8) contiguous pages (64Kb). ==> 16 Extents = 1Mb
Types of extents: Mixed and Uniform

(a) Uniform: owned by a single object

(b) Mixed: shared by up to eight objects.





Install SQL Developer 3.0 on Ubuntu 10.04

Ok, so I needed to perform some tests of Oracle's SQL Developer 3.0 runing on Ubuntu, so I decided to install it on a machine running Lucid Lynx 10.4. These are the steps I followed (following the guidelines that mick has posted.)

Requirement: Ensure you have a JDK installed
SQL Developer requires that the Sun Java J2SE JDK 1.6.11 or later be installed on the system. To install JDK, use the command:
$ sudo apt-get install sun-java6-jdk

Here you may receive the error message below:
Package sun-java6-jdk is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source
E: Package sun-java6-jdk has no installation candidate

To solve this problem, add a new source to the aptitude repository, then try installing again:
$ sudo add-apt-repository "deb http://archive.canonical.com/ lucid partner"
$ sudo apt-get update
$ sudo apt-get install sun-java6-jdk

Download the files below
(a) Download the software
You will need to log in the OTN site and go to the address below and download the file titled “Oracle SQL Developer for other platforms.”

http://www.oracle.com/technetwork/developer-tools/sql-developer/downloads/index.html

(b) Install the make-sqldeveloper-package package
$ sudo apt-get install sqldeveloper-package
sqldeveloper-package
builds a .deb package
// builds a Debian package of Oracle SQL Developer from the architecture independent archive from , identified as "Oracle SQL Developer for other platforms."

// you can check the contents of a package with

$ dpkg -L

To download the sqldeveloper-package you will need Ubuntu’s multiverse software repository.





(c) Install the tofrodos package
$ sudo apt-get install tofrodos

// Create symbolic links to the tofrodos commands to 
// allow the sqldeveloper-package to work:
$ sudo ln -s /usr/bin/fromdos /usr/bin/dos2unix
$ sudo ln -s /usr/bin/todos /usr/bin/unix2dos
tofrodos package
Converts DOS <-> Unix text files
// DOS text files have CR/LF pairs as their new line delimiters while Unix text files have LFs (line feeds) only
// Tofrodos comprises one program, "fromdos" alias "todos", which converts text files to and from these formats. Use "fromdos" to convert DOS text files to the Unix format, and "todos" to convert Unix text files to the DOS format.










Convert the ZIP file to .DEB package
To convert the .zip file to a .deb package, use the command below::

The make-sqldeveloper-package command will
(1) create a temporary directory at the location indicated by (i.e. /tmp/build)
(2) use the temporary directory to build the .deb package
(3) write the new package in the directory
(4) remove the temporary directory

So, if you saved the .zip file in the current directory, you could issue the command:



Install SQL Developer
To install, run:

$ sudo dpkg -i sqldeveloper_3.0.04.34+0.2.3-1_all.deb

This should install Oracle SQL Developer and you'll end up with a new entry in Gnome's menu:
Applications->Programming->SQL Developer








Inform the location of JDK
When you run SQL Developer for the first time, you may receive the message below on a terminal window, if it cannot find the location of JDK (SQL Developer expects to find the path information in the file ~/.sqldeveloper/jdk):
Oracle SQL Developer
Copyright (c) 2008, Oracle. All rights reserved.

Type the full pathname of a J2SE installation (or Ctrl-C to quit), the path will be stored in ~/.sqldeveloper/jdk

To fix this, you need to (a) create the directory .sqldeveloper; (b) create the jdk file and type in the path to the JDK:
$ mkdir -p ~/.sqldeveloper
$ vi ~/.sqldeveloper/jdk
# enter the path to JDK: /usr/lib/jvm/java-6-sun

Now you should be able to use SQL Developer 3.0

Install Oracle XE 10gr2 on Ubuntu 10.4


Oracle XE 10.2 licence limitations
Before you install, please consider the restrictions below. Oracle XE is offered as a free server for developers and small applications. The only way to overcome the limitations indicated below is to use the standard or enterprise editions.

(a) XE Server will use only one CPU
- If installed on a computer with more than one CPU (including dual-core CPUs), Oracle XE will consume, at most, processing resources equivalent to one CPU. In other words, even with available CPUs, Oracle XE will not do concurrent processing of CPU-intensive queries.

(b) Only one instance per computer
- Only one installation of Oracle XE can be performed on a single computer. This will not affect any existing installation or new installations of Standard or Enterprise Editions. In addition, users can run only one instance of Oracle XE on each individual computer.

(c) Maximum 4Gb of user data
- The maximum amount of user data in an Oracle XE database cannot exceed 4Gb. (In the oracle XE 11g - beta version, this limit was increased to 11Gb). If the user data grows beyond the 4Gb limit, then an ORA-12592 error will occur.

(d) Maximum 1Gb RAM
- An Oracle XE database will use at most 1Gb of RAM, even if more is available.

(e) No native support for HTTPS
- HTTPS is not supported natively with the HTTP listener built into Oracle Database XE. If you want HTTPS support, use an alternative Web listener, such as Apache, that does provide HTTPS support, and provide proxies for the URLs provided by Oracle Database XE.

With the limitations indicated above and with the idea of providing a RDBMS with a small footprint, it is not surprising that many of the features available in the Standard and Enterprise editions are not included with Oracle XE. Some of these are partitioning, OLAP, clusterware, the "Packs" (change and configuration management, diagnostic and tuning). See the full list here.


Installation Requirements
(a) Kernel requirements
The installation program checks for the kernel parameter settings below. If the current parameter values are less than the values listed below, they will be modified by the installation program.
ParameterValue
semmsl, semmns, semmni, semopm250, 32000, 128, 100
shmax, shmmni, shmall536870912, 4096, 2097152
file-max65536
ip_local_port_range1024-65000

(b) Required packages
You need to have glibc and libaio installed.


Download the software
You need to be logged in on your OTN account. You may use the link below:
http://www.oracle.com/technetwork/database/express-edition/downloads/102xelinsoft-102048.html
Download the debian package (.deb).

Installation
(a) To install the package, run the command below. The installation program automatically creates user oracle, if it not yet exists.


(b) Alternative Installation mode
On Debian-based systems such as Ubuntu, you can download and install the .deb package through these steps:

(1) Edit the /etc/apt/sources.list and add:
# Repository for Oracle XE
deb http://oss.oracle.com/debian unstable main non-free

(2) install with:
$ sudo apt-get update
$ sudo apt-get install oracle-xe

(c) Configuring default ports, passwords, and startup options.
When prompted, run the command below. It allows you to change the default http and listener ports, set up the initial password for SYS and SYSTEM, and decide whether the server will be automatically started during boot:


Oracle Database 10g Express Edition Configuration
-------------------------------------------------
This will configure on-boot properties of Oracle Database 10g Express
Edition. The following questions will determine whether the database should
be starting upon system boot, the ports it will use, and the passwords that
will be used for database accounts. Press to accept the defaults.
Ctrl-C will abort.

Specify the HTTP port that will be used for Oracle Application Express [8080]:

Specify a port that will be used for the database listener [1521]:

Specify a password to be used for database accounts. Note that the same
password will be used for SYS and SYSTEM. Oracle recommends the use of
different passwords for each database account. This can be done after
initial configuration:
Confirm the password:

Do you want Oracle Database 10g Express Edition to be started on boot (y/n) [y]:n

Starting Oracle Net Listener...Done
Configuring Database...
Done
Starting Oracle Database 10g Express Edition Instance...Done
Installation Completed Successfully.

Set the Oracle XE Environment Variables

bash shell configuration scripts:
.bash_profile
// executed during initial login
.bashrc
// executed in each new terminal window

To connect to the XE server you must set your environment variables. One way to do it is to edit your .bashrc login script and include the line below. After this when you open a new terminal window the environment variables will be automatically set.

$ vi ~/.bashrc
# paste the two lines below at the end of the file:
# set Oracle XE environment variables
. /usr/lib/oracle/xe/app/oracle/product/10.2.0/server/bin/oracle_env.sh 

If you are using the bash shell, the execution of the oracle_env.sh script may produce the error message below:
/usr/lib/oracle/xe/app/oracle/product/10.2.0/server/bin/nls_lang.sh: 114: [[: not found


To fix this problem, edit the nls_lang.sh file indicated in the error message. As root (or though sudo) you need to tell the script to use the proper shell. In this case:

$ sudo vi /usr/lib/oracle/xe/app/oracle/product/10.2.0/server/bin/nls_lang.sh
change the first line in the file nls_lang.sh 
from #! /bin/sh 
to   #! /bin/bash 

Acessing the database
After the installation, the database should be up and running.
To use the XE database, you can go to the Database Home Page in the Oracle Database XE graphical user interface.:
http://host:port/apex or httpL//127.0.0.1:8080/apex (if you kept the default port for the http listener)

The installation creates a database and an instance named XE.


Starting and Shutting down
You can startup the database either through the Desktop Menus:
Applictations -> Oracle Database 10g Express Edition -> Start Database
or using SQL*Plus:
# Log in as a user who is a member of the dba group
$ sqlplus / as sydba
SQL> startup

If all went well, you should see:

ORACLE instance started.

Total System Global Area 805306368 bytes
Fixed Size 1261444 bytes
Variable Size 218103932 bytes
Database Buffers 583008256 bytes
Redo Buffers 2932736 bytes
Database mounted.
Database opened.
SQL>

Network connections
The Listener manages database (default port 1521) and HTTP (default port 8080) connections.
To manage the listener (status/start/shutdown) you need to be logged in as oracle.
LSNRCTL> start

Starting /usr/lib/oracle/xe/app/oracle/product/10.2.0/server/bin/tnslsnr: please wait...

TNSLSNR for Linux: Version 10.2.0.1.0 - Production
System parameter file is /usr/lib/oracle/xe/app/oracle/product/10.2.0/server/network/admin/listener.ora
Log messages written to /usr/lib/oracle/xe/app/oracle/product/10.2.0/server/network/log/listener.log
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC_FOR_XE)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=niels.blump)(PORT=1521)))

Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=EXTPROC_FOR_XE)))
STATUS of the LISTENER
------------------------
Alias LISTENER
Version TNSLSNR for Linux: Version 10.2.0.1.0 - Production
Start Date 13-JAN-2011 09:14:42
Uptime 0 days 0 hr. 0 min. 0 sec
Trace Level off
Security ON: xxxx
SNMP OFF
Default Service XE
Listener Parameter File /usr/lib/oracle/xe/app/oracle/product/10.2.0/server/network/admin/listener.ora
Listener Log File /usr/lib/oracle/xe/app/oracle/product/10.2.0/server/network/log/listener.log
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC_FOR_XE)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=niels.blump)(PORT=1521)))
Services Summary...
Service "PLSExtProc" has 1 instance(s).
Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service...
The command completed successfully