Particle Swarm Optimization

Optimizing a non-linear problem using traditional newtonian methods is often infeasible. Then you may try a grid-type of search, trying to exhaust all of search space. If your space is too big, you have to try non-exhaustive methods. One interesting method is known as the Particle Swarm-algorithm. Read an introduction.