I have just done the test and it worked well.
You need to go around the edge of the shape with the mouse and make notes of x and y coordinates (with a pen and a paper!), then put them in an array.
My array looks like this:
var arrayPoints:Array = [[22, 0], [41, 6], [52, 24], [52, 51], [36, 73], [14, 79], [2, 62], [6, 39], [0, 16], [7, 0]];
So now I have coordinates of 10 points around the edge of the shape.
Just go through them and see if any of the points in the array is inside another shape.
(Flash 8 BitmapData.hitTest is FAR EASIER than this, by the way...)
Kenneth Kawamoto