Even more fun: complex-order derivatives! here and here.
Another way to generalize derivatives: Lanczos derivatives.
"The least-squares property of Lanczos derivatives" by Burch, Fishback, and Gordon.
Mathematics Magazine, Vol 78 number 5, December 2005, pages 368-378