Small oligomeric forms of amyloid-β (Aβ) are believed to be the culprit for declined brain functions in AD in part through their impairment of neuronal trafficking and synaptic functions. However, the precise cellular actions of Aβ oligomers and underlying mechanisms in neurons remain to be fully defined. Previous studies have identified mitochondria as a major target of Aβ toxicity contributing to early cognitive decline and memory loss in neurodegenerative diseases including Alzheimer's disease (AD). In this study, we report that Aβ oligomers acutely elicit distinct effects on the transport and integrity of mitochondria. We found that acute exposure of hippocampal neurons to Aβ oligomers from either synthetic peptides or AD brain homogenates selectively impaired fast transport of mitochondria without affecting the movement of late endosomes and lysosomes. Extended exposure of hipoocampal neurons to Aβ oligomers was found to result in mitochondrial fragmentation. While both mitochondrial effects induced by Aβ oligomers can be abolished by the inhibition of GSK3β, they appear to be independent from each other. Aβ oligomers impaired mitochondrial transport through HDAC6 activation whereas the fragmentation involved the GTPase Drp-1. These results show that Aβ oligomers can acutely disrupt mitochondrial transport and integrity in a time-dependent and pathway-specific manner. These findings thus provide new insights into Aβ-induced mitochondrial defects that may contribute to neuronal dysfunction and AD pathogenesis.