Evolving Cutting Horse and Sheepdog Behavior on a Simulated Flock Chris Beacham

Abstract The focus of this project is attempting to evolve the behavior of a single agent or small group of agents so that they can effectively direct the movement of a much larger group which displays flocking behavior. This is the same role sheepdogs play to manage herds of livestock.

Other Research There has been little development in this specific field. Flocking algorithm is well established, but is hard to direct. Robotic Sheepdog Project: Proof of Concept for robotic handling of livestock

Uses Two main Applications: Animation – Control direction of flocks in animations, currently no good method exists Livestock Herding: Could be used in a robotic agent to actually herd livestock. Could reduce livestock stress.

Programming Tools Python is being used for the code, with tKinter providing the graphics. Breve was looked at as a possibility, but it was dismissed for being to complex and not documented.

Precursors Initially, an evolution program was written to fine tune the authors understanding of artificial evolution. This is a genepool of evolved creatures using user selection

Sheepdog and Cutting Horse The sheepdog directs the movements of sheep, ducks, cows, goats and other herd stock. It accomplishes this by moving around the herd or flock in specific ways. The cutting horse is used with herds of cattle. It’s job is to single out a single cow, and “cut” it off from the herd, thus allowing people to access it.

Flocking The herd will be simulated with a flocking algorithm. Three algorithms make up flocking behavior: Separation Cohesion Alignment

First Quarter The first quarter was spent creating a flocking behavior simulation, and debugging it. This is a screenshot of a flock flying to the right.

Second Quarter Herding behavior established. Same algorithm as flocking.

Second Quarter Herd reacting to ‘predator’ Sheepdog agent very simple at this point

Second Quarter Which behavior determination system to use? Neural Networks v. Cellular Automaton v. Weighting Pros and Cons for all options

Second Quarter Weighting method chosen as best behavior determination system. Genetic code adds weight to different variables. Pros Many strategies can be produced Should be reproducible in other situations Cons Nowhere near the possibilities for innovation of neural nets.

Second Quarter First generation sheepdog behavior is randomly generated. Movement is very chaotic.

First Generation This is a sample of the genetic pool of the first generation. [ , , , , , , , , , ], [ , , , , , , , , , ], [ , , , , , , , , , ], [ , , , , , , , , , ], [ , , , , , , , , , ], [ , , , , , , , , , ], [ , , , , , , , , , ], [ , , , , , , , , , ],

Third Quarter Breeding program and Automated testing program produced. Breeding program designed for very heavy selection pressure Agents evaluated on how close they get the flock to the goal.

Third Quarter Several strategies predominate “Bubble” strategy “Slow” strategy “Southeast” strategy “Spinning wheel” strategy “Wall-bounce” strategy – suspect disconnect between graphical output and nongraphical output

Are any Strategies Viable? Two applications: Animations and Livestock Livestock – Possible, but unknown. Real experience needed. Animation – depends on application. Some strategies significantly distort flock shape

Continued Development Expected to continue over the summer Three main goals –Simulated flock to reflect real flock movement –More vectors in weighing system –Modification of breeding algorithm for more biodiversity Also, simulation is computationally intensive, so need to secure a location to run it long-term.