For the sauce: Bring orange juice, lemon juice, brown sugar, orange zest, and lemon zest to a boil in a saucepan over medium-high heat. Reduce heat to medium-low and simmer until slightly thickened, about 5 minutes. Remove from heat and stir in vanilla extract. Set aside to cool.
For the salad: Layer fruit in a large bowl. Pour cooled sauce over fruit; cover and refrigerate for 3 to 4 hours before serving.