Ashit
Talukder's Web Page at the Jet Propulsion Laboratory/ Caltech
|
Address:
Senior Research Scientist, Level A
JPL, 4800 Oak Grove Drive,
MS 300-123, Pasadena, CA 91109
Email: ashit.talukder@jpl.nasa.gov
Phone: 818 354 1000, Fax 818 393 3302
|
|
I am a Senior Research Scientist (Level A) at the
Jet Propulsion Laboratory/NASA, California Institute of Technology,
located in Pasadena, CA, USA. I also hold an appointment as an Associate
Professor at the Univ. of Southern California (webpage is located here
). I have a PhD from the Dept.
of Electrical and Computer Engineering, Carnegie Mellon University where
I worked with Prof. David
Casasent. I obtained my M.S. at Iowa State University where I worked
with Dr. Jennifer
Davidson . I am a principal investigator in several projects funded by DARPA, NASA,
Dept. of Homeland Security, U.S. Army, commercial organizations, and the
NIH, in a variety of areas spanning multidisciplinary areas in computer
science and engineering, ranging from robotics, biometrics, intelligent sensor networks,
sensor fusion, data mining, and system optimization and control to machine learning, computer vision,
pattern recognition, and image processing. I have directly
supervised, and managed over 16 researchers comprised of research senior staff
and post-docs at USC and JPL including recruiting and building the team,
conducting administrative oversight, technical leadership, and providing vision
and guidance to the entire team.
I have
more than 65 publications in journals and conference proceedings. I have
given 2 plenary lectures at international conferences and workshops, a colloquial lecture at
the University of South Florida, several invited talks at conferences and academic institutions, and
3 Keynote Addresses at conferences. I am a
member of the technical organizing committee of the Optical Pattern Recognition Conference in
the Annual SPIE Defense and Security Symposium (formerly known as the
Annual SPIE AeroSense Conference), held in Orlando, FL every year during
April. I have chaired several conference sessions (including sessions on Optical
Pattern Recognition and "
Active vision in robotics " at Photonics East, Intelligent
Robotics and Computer Vision XVII), and am a reviewer on several journals
(IEEE Trans. Image Processing, IEEE Transactions on Signal Processing,
IEEE Transactions on Systems, Man, and Cybernetics-B, Applied Optics,
Neurocomputing, Neural Networks, and Optical Engineering).
My detailed research accomplishments are listed in my CV (not up to
date!!).
.
Research Interests and Activities
My interests are in the general broad area of Autonomous Systems, including:
- Robotics and
unmanned systems with autonomy
- Multimedia and Cross-Media Data mining,
Search and Retrieval
- Standards and evaluation for multimedia data analysis, search and
retrieval (contact me for our science datasets used for evaluation of
cross-media data analysis for event detection and tracking)
- Image, signal, and video processing
- Wireless Sensor Networks, Wireless sensors and systems for space, health, science, and defense
- Autonomy in Remote Wireless Systems and Embedded Systems
- Control optimization, Scheduling and Resource
Management Theory, Real-time distributed control, resource allocation with low latency
-
Machine learning , Active Learning, Transfer Learning, Artificial Intelligence
-
Machine vision,
image processing , signal and multidimensional
processing
-
Neural networks,
Pattern recognition, Statistics, Stochastic modeling,
support vector machines and kernel machines
- Feature extraction and dimensionality reduction from
structured and unstructured data
- Sensor fusion and real-time multisensor processing
and adaptation
- Numerical, mathematical, and algebraic methods
applied to diverse fields
- Active learning
- Novel embedded signal processing for low power sensors and instruments
- Embedded control and processing combined with novel hardware designs
- Algorithms and algorithm development
Applications and fields I've worked in over the past several
years include:
- Sensor networks for mobile health monitoring, environmental
monitoring, and defense
- Biometrics and surveillance systems
- Multi-band adaptive software defined radio hardware design with small
(mobile) form-factors for extremely low-power applications
- Distributed optimal control of multiple wireless heterogeneous sensor nodes
- Adaptive multiple software defined radio control and resource
allocation
- Robotics, active vision/perception, and active
learning
- Human-machine interaction, face detection and
recognition
- Image processing applied to various fields, speech
processing and recognition
- Biomedical image and signal processing
- Materials Science
- Sensors and sensor fusion
- Automatic target recognition
- Product inspection
My PhD dissertation at Carnegie Mellon University entitled "
Nonlinear Feature Extraction for Pattern Recognition Applications" involved the design of new
machine learning techniques for nonlinear kernel-based feature extraction that I developed
independently of support vector machines and kernel-PCA, and have shown
to outperform SVMs and kernel PCA on highly nonlinear, high-dimensional
data sets such as images and multi-dimensional data. You can
download a copy of my PhD thesis here. If you need a PDF file, please
email me at Ashit.Talukder@jpl.nasa.gov
and I will gladly send you a PDF file of my thesis.
I've led and worked on several industrial and federal
funded projects at JPL, USC, and CMU . A few of the relevant projects are
listed below. While this list below is not comprehensive, it covers some of
areas that I have worked on in the past.
Research and Commercial
Projects
Biometrics and Surveillance Systems
We have built state of the art biometrics and surveillance systems for
several federal sponsors. The system is a multimodal long-standoff biometrics
system, that can detect human at a long standoff distance, identify them using
the multimodal measurements. We have unique capability to detect a human behind
a wall and also determine the identity of an individual through
walls at a long distance (compared to existing solutions that can only detect
the presence of a person behind walls). Due to the sensitive nature of
this work, the technical details of the biometrics and surveillance system
cannot be provided online.
Wireless Intelligent Sensor Networks
and Software Defined Radios with real-time Resource
Allocation Capabilities
In this task, we have developed a wireless adaptive sensor network hardware
testbed with nodes that run for days, developed distributed sensing algorithms
using novel pattern recognition techniques and sensor fusion algorithms, and
designed and implemented new control optimization and resource allocation
algorithms for real-time distributed end-to-end system management. Our primary
contributions are:
- A multi-node sensor network testbed with generic
COTS sensor hookup capability where each node can last for days or weeks
(see the hardware components and sensors currently in place in our sensor
network in Figure 2 below)
- A novel heirarchical sensor network architecture
(see Figure 1 below)where higher levels have increased functional and
computational capabilities
- Real-time event detection and data prioritization
capability at every node using pattern recognition techniques
- Sensor fusion from heterogeneous distributed
sensors at higher levels in the sensor network, thereby enabling robust
event detection and intelligent decision making
- Novel Genetic algorithm and Model-predictive
control based control optimization solutions for integrated resource
management in our sensor network.
- Visualization tools at Level 3 that automatically
mark detected events as alarms. This will enable experts to focus in
on specific events and time-intervals of interest. See Figure 3
below.

Wireless distributed
sensor network architecture

Levels 1 and
2
Levels 1, 2, and 3 in the sensor network

Event visualization tools in Level 3 of our sensor network
Adaptive Control and Resource Management in Multiple Distributed Sensor Networks
and Software Defined Radios
We have designed and implemented novel control
algorithms for real-time adaptive operation of multiple RF nodes in
dynamic environments where the channel noise and ambient RF noise
characteristics can change dramatically based on the relative postion and motion
between nodes. We use novel Model Predictive Control Algorithms
on RF nodes with reasonable storage/memory resources, and Markov
Decision Processes
on RF nodes with extremely limited storage/limited resources (less than 4K of
memory) for adaptive resource management and coordinated operation of the SDR
nodes, where each node has different computing, momory and RF
characteristics. We believe our work in this area to be
the first demonstrable example of real-time adaptive control of distributed
wireless nodes and software-programmable radios with such limited computing and
storage resources
.
Coordination of Unmanned Mobile Robots with Wireless Sensor Networks for Coastal Environmental
Monitoring
We developed a novel framework for controlling operational parameters of both
fixed sensors and mobile unmanned robots in real-time and using the resulting sensor
observations to increase the predictive accuracy of pre-computed mathematical
models of the ocean environment. The sensor controller uses the Model Predictive
Control technique to focus limited sensor resources to the regions that are most
likely to impact the accuracy of the model forecasts. The system was
demonstrated on an offline simulation of the environment of the New York harbor
and ocean. The sensor network adaptation and resource management concept for
coastal monitoring networks are shown below.
