Orthogonality

You don't need to be Editor-In-Chief to add or edit content to WikiDoc. You can begin to add to or edit text on this WikiDoc page by clicking on the edit button at the top of this page. Next enter or edit the information that you would like to appear here. Once you are done editing, scroll down and click the Save page button at the bottom of the page.

(Redirected from Orthogonal)

Please Take Over This Page and Apply to be Editor-In-Chief for this topic: There can be one or more than one Editor-In-Chief. You may also apply to be an Associate Editor-In-Chief of one of the subtopics below. Please mail us [1] to indicate your interest in serving either as an Editor-In-Chief of the entire topic or as an Associate Editor-In-Chief for a subtopic. Please be sure to attach your CV and or biographical sketch.

Overview

In mathematics, orthogonal, as a simple adjective not part of a longer phrase, is a generalization of perpendicular. It means "at right angles". The word comes from the Greek ὀρθός (orthos), meaning "straight", and γωνία (gonia), meaning "angle". Two streets that cross each other at a right angle are orthogonal to one another. In recent years, "perpendicular" has come to be used more in relation to right angles outside of a coordinate plane context, whereas "orthogonal" is used when discussing vectors or coordinate geometry.

Explanation

Formally, two vectors $x$ and $y$ in an inner product space $V$ are orthogonal if their inner product $\langle x, y \rangle$ is zero. This situation is denoted $x \perp y$ .

Two vector subspaces $A$ and $B$ of vector space $V$ are called orthogonal subspaces if each vector in $A$ is orthogonal to each vector in $B$ . The largest subspace that is orthogonal to a given subspace is its orthogonal complement.

A linear transformation $T : V \rightarrow V$ is called an orthogonal linear transformation if it preserves the inner product. That is, for all pairs of vectors $x$ and $y$ in the inner product space $V$ ,

$\langle Tx, Ty \rangle = \langle x, y \rangle.$

This means that $T$ preserves the angle between $x$ and $y$ , and that the lengths of $T x$ and $x$ are equal.

A term rewriting system is said to be orthogonal if it is left-linear and is non-ambiguous. Orthogonal term rewriting systems are confluent.

The word normal is sometimes also used in place of orthogonal. However, normal can also refer to unit vectors. In particular, orthonormal refers to a collection of vectors that are both orthogonal and normal (of unit length). So, using the term normal to mean "orthogonal" is often avoided.

In Euclidean vector spaces

In 2- or 3-dimensional Euclidean space, two vectors are orthogonal if their dot product is zero, i.e. they make an angle of 90° or π/2 radians. Hence orthogonality of vectors is a generalization of the concept of perpendicular. In terms of Euclidean subspaces, the orthogonal complement of a line is the plane perpendicular to it, and vice versa. Note however that there is no correspondence with regards to perpendicular planes, because vectors in subspaces start from the origin.

In 4-dimensional Euclidean space, the orthogonal complement of a line is a hyperplane and vice versa, and that of a plane is a plane.

Several vectors are called pairwise orthogonal if any two of them are orthogonal, and a set of such vectors is called an orthogonal set. Such a set is an orthonormal set if all its vectors are unit vectors. Non-zero pairwise orthogonal vectors are always linearly independent.

Orthogonal functions

It is common to use the following inner product for two functions f and g:

$\langle f, g\rangle_w = \int_a^b f(x)g(x)w(x)\,dx.$

Here we introduce a nonnegative weight function $w (x)$ in the definition of this inner product.

We say that those functions are orthogonal if that inner product is zero:

$\int_a^b f(x)g(x)w(x)\,dx = 0.$

We write the norms with respect to this inner product and the weight function as

$||f||_w = \sqrt{\langle f, f\rangle_w}$

The members of a sequence { f_i : i = 1, 2, 3, ... } are:

orthogonal if

$\langle f_i, f_j \rangle=\int_{-\infty}^\infty f_i(x) f_j(x) w(x)\,dx=||f_i||^2\delta_{i,j}=||f_j||^2\delta_{i,j}$

orthonormal

$\langle f_i, f_j \rangle=\int_{-\infty}^\infty f_i(x) f_j(x) w(x)\,dx=\delta_{i,j}$

where

$\delta_{i,j}=\left\{\begin{matrix}1 & \mathrm{if}\ i=j \\ 0 & \mathrm{if}\ i\neq j\end{matrix}\right\}$

is the Kronecker delta. In other words, any two of them are orthogonal, and the norm of each is 1 in the case of the orthonormal sequence. See in particular orthogonal polynomials.

Examples

The vectors (1, 3, 2), (3, −1, 0), (1/3, 1, −5/3) are orthogonal to each other, since (1)(3) + (3)(−1) + (2)(0) = 0, (3)(1/3) + (−1)(1) + (0)(−5/3) = 0, (1)(1/3) + (3)(1) − (2)(5/3) = 0. Observe also that the dot product of the vectors with themselves are the norms of those vectors, so to check for orthogonality, we need only check the dot product with every other vector.

The vectors (1, 0, 1, 0, ...)^T and (0, 1, 0, 1, ...)^T are orthogonal to each other. Clearly the dot product of these vectors is 0. We can then make the obvious generalization to consider the vectors in Z₂ⁿ:

$\mathbf{v}_k = \sum_{\begin{matrix}i=0\\ai+k < n\end{matrix}}^{n/a} \mathbf{e}_i$

for some positive integer a, and for 1 ≤ k ≤ a − 1, these vectors are orthogonal, for example (1, 0, 0, 1, 0, 0, 1, 0)^T, (0, 1, 0, 0, 1, 0, 0, 1)^T, (0, 0, 1, 0, 0, 1, 0, 0)^T are orthogonal.

Take two quadratic functions 2t + 3 and 5t² + t − 17/9. These functions are orthogonal with respect to a unit weight function on the interval from −1 to 1. The product of these two functions is 10t³ + 17t² − 7/9 t − 17/3, and now,

$\int_{-1}^{1} \left(10t^3+17t^2-{7\over 9}t-{17\over 3}\right)\,dt = \left[{5\over 2}t^4+{17\over 3}t^3-{7\over 18}t^2-{17\over 3}t\right]_{-1}^{1}$

$=\left({5\over 2}(1)^4+{17\over 3}(1)^3-{7\over 18}(1)^2-{17\over 3}(1)\right)-\left({5\over 2}(-1)^4+{17\over 3}(-1)^3-{7\over 18}(-1)^2-{17\over 3}(-1)\right)$

$={19\over 9}-{19\over 9}=0.$

The functions 1, sin(nx), cos(nx) : n = 1, 2, 3, ... are orthogonal with respect to Lebesgue measure on the interval from 0 to 2π. This fact is basic in the theory of Fourier series.

Various eponymously named polynomial sequences are sequences of orthogonal polynomials. In particular:
- The Hermite polynomials are orthogonal with respect to the normal distribution with expected value 0.
- The Legendre polynomials are orthogonal with respect to the uniform distribution on the interval from −1 to 1.
- The Laguerre polynomials are orthogonal with respect to the exponential distribution. Somewhat more general Laguerre polynomial sequences are orthogonal with respect to gamma distributions.
- The Chebyshev polynomials of the first kind are orthogonal with respect to the measure $1/\sqrt{1-x^2}.$
- The Chebyshev polynomials of the second kind are orthogonal with respect to the Wigner semicircle distribution.

In quantum mechanics, two eigenstates of a wavefunction, $ψ m$ and $ψ n$ , are orthogonal if they correspond to different eigenvalues. This means, in Dirac notation, that $\langle \psi_m | \psi_n \rangle = 0$ unless $ψ m$ and $ψ n$ correspond to the same eigenvalue. This follows from that Schrödinger's equation is a Sturm-Liouville equation (in Schrödinger's formulation) or that observables are given by hermitian operators (in Heisenberg's formulation).

Derived meanings

Other meanings of the word orthogonal evolved from its earlier use in mathematics.

Art

In art the perspective imagined lines pointing to the vanishing point are referred to as 'orthogonal lines'.

Computer science

Orthogonality is a system design property facilitating feasibility and compactness of complex designs. Orthogonality guarantees that modifying the technical effect produced by a component of a system neither creates nor propagates side effects to other components of the system. The emergent behavior of a system consisting of components should be controlled strictly by formal definitions of its logic and not by side effects resulting from poor integration, i.e. non-orthogonal design of modules and interfaces. Orthogonality reduces testing and development time because it is easier to verify designs that neither cause side effects nor depend on them.

For example, a car has orthogonal components and controls (e.g. accelerating the vehicle does not influence anything else but the components involved exclusively with the acceleration function). On the other hand, a non-orthogonal design might have its steering influence its braking (e.g. Electronic Stability Control), or its speed tweak its suspension.^[1] Consequently, this usage is seen to be derived from the use of orthogonal in mathematics: One may project a vector onto a subspace by projecting it onto each member of a set of basis vectors separately and adding the projections if and only if the basis vectors are mutually orthogonal.

An instruction set is said to be orthogonal if any instruction can use any register in any addressing mode. This terminology results from considering an instruction as a vector whose components are the instruction fields. One field identifies the registers to be operated upon, and another specifies the addressing mode. An orthogonal instruction set uniquely encodes all combinations of registers and addressing modes.

Radio communications

In radio communications, multiple-access schemes are orthogonal when an ideal receiver can completely reject arbitrarily strong unwanted signals using different basis functions than the desired signal. One such scheme is TDMA, where the orthogonal basis functions are non-overlapping rectangular pulses ("time slots").

Another scheme is orthogonal frequency-division multiplexing (OFDM), which refers to the use, by a single transmitter, of a set of frequency multiplexed signals with the exact minimum frequency spacing needed to make them orthogonal so that they do not interfere with each other. Well known examples include (a and g) versions of 802.11 Wi-Fi; Wimax; DVB-T, the terrestrial digital TV broadcast system used in most of the world outside North America; and DMT, the standard form of ADSL.

Statistics, econometrics, and economics

When performing statistical analysis, variables that affect a particular result are said to be orthogonal if they are uncorrelated.^[1] That is to say that by varying each separately, one can predict the combined effect of varying them jointly. If correlation is present, the factors are not orthogonal. In addition, orthogonality restrictions are necessary for inference. This meaning of orthogonality derives from the mathematical one, because orthogonal vectors are linearly independent.

Taxonomy

In taxonomy, an orthogonal classification is one in which no item is a member of more than one group, that is, the classifications are mutually exclusive.

Combinatorics

In combinatorics, two n×n Latin squares are said to be orthogonal if their superimposition yields all possible n² combinations of entries.

Chemistry

In chemistry orthogonal protection is a strategy allowing the deprotection of functional groups independently of each other.

External links

Chapter 4 - Compactness and Orthogonality in The Art of Unix Programmingbg:Ортогоналност

ca:Ortogonal cs:Ortogonalita da:Ortogonal de:Orthogonalität eo:Ortogonalo fr:Orthogonalité he:אורתוגונליות nl:Orthogonaal ja:直交 sr:Ортогоналност sv:Ortogonalitet

WikiDoc Help Menu

Quick Start..

Editing basics

Advanced editing

Communicating your edits

Help Videos You Can Watch

Getting Started Video

Acknowledgement and Attribution Regarding Sources of Content

Some of the initial content on this page may be incorporated in part from copyleft sources in the public domain including wikis such as Wikipedia and AskDrWiki. Drug information for patients came from the The National Library of Medicine. Infectious disease information may have come from the Centers for Disease Control (CDC). Differential Diagnoses are drawn from clinicians as well as an amalgamation of 3 sources: 1.The Disease Database; 2. Kahan, Scott, Smith, Ellen G. In A Page: Signs and Symptoms. Malden, Massachusetts: Blackwell Publishing, 2004:3; 3. Sailer, Christian, Wasner, Susanne. Differential Diagnosis Pocket. Hermosa Beach, CA: Borm Bruckmeir Publishing LLC, 2002:7 .

[1]

[1]

Orthogonality

Overview

Explanation

In Euclidean vector spaces

Orthogonal functions

Examples

Derived meanings

Art

Computer science

Radio communications

Statistics, econometrics, and economics

Taxonomy

Combinatorics

Chemistry

See also

External links

Acknowledgement and Attribution Regarding Sources of Content

Views

Personal tools

Search

Navigation

Help

Toolbox

In other languages