In current breast ultrasound Computer Aided Diagnosis systems, the radi- ologist preselects a region of interest (ROI) as an input for computerized breast ultrasound image analysis. This task is time consuming and there is inconsistency among human experts. Researchers attempting to automate the process of obtaining the ROIs have been relying on image processing and conventional machine learning methods. We propose the use of a deep learn- ing method for breast ultrasound ROI detection and lesion localisation. We use the most accurate object detection deep learning framework – Faster- RCNN with Inception-ResNet-v2 – as our deep learning network. Due to the lack of datasets, we use transfer learning and propose a new 3-channel artificial RGB method to improve the overall performance. We evaluate and compare the performance of our proposed methods on two datasets (namely, Dataset A and Dataset B), i.e. within individual datasets and composite dataset. We report the lesion detection results with two types of analysis: 1) detected point (centre of the segmented region or the detected bounding box) and 2) Intersection over Union (IoU ). Our results demonstrate that the proposed methods achieved comparable results on detected point but with notable improvement on IoU. In addition, our proposed 3-channel artificial RGB method improves the recall of Dataset A. Finally, we outline some future directions for the research.