Soft transduction technology is rapidly adopting soft active elastomer-based minimum energy structures because of their distinctive programmable shape-morphing characteristics. For effective device design, an understanding of the nonlinear dynamic behavior is crucial as they often experience time-dependent motion while operating. Moreover, there has been an increasing scientific interest in enhancing the actuation performance of soft active elastomers by imparting particle reinforcements. This article provides a theoretical framework for investigating the nonlinear dynamics of smart composite elastomer-based minimum energy structures (SCEMES) with the provision of non-aligned electric and magnetic fields, leading to an actively programmable pre-stretch paradigm. Unlike conventional actuators, the proposed SCEMES is made up of a polymer that has electro-magnetic properties and is filled with appropriate fillers with specific volume fractions. An electromagneto-viscoelastic model is developed here to predict actuator behavior and investigate the effects of particle reinforcement on equilibrium and actuated configurations. Besides strengthening the polymer, particle reinforcement is observed to enhance the equilibrium angle achieved by the structure with enhanced functionality. The proposed nonlinear dynamic model is extended to investigate a number of critically influential parameters, including shear modulus ratio of fiber to matrix, frame bending stiffness, membrane pre-stretching, and electro-magnetic loading with time-dependent DC and AC modes of actuation. The results reveal that the combined electro-magnetic actuation enhances the actuation range significantly. The attained tip angle of the actuator increases appreciably when the magnetic and electric fields are applied mutually perpendicular to each other, indicating that the direction of applied magnetic field governs the attained actuated configuration. Further, particle reinforcement enrichments result in a depletion in oscillation amplitudes and an increase in excitation frequencies under the AC actuation mode. The efficient semi-analytical framework presented here would be crucial in developing new actuators, smart devices and soft robots for a variety of advanced engineering and medical applications.