Hi
@Fullmoonfever,
I found the following paper about skin lesion classification on edge devices that goes along with the GitHub account you discovered the other day - it was published on
www.arxiv.org on 21 July and is called “Quantization-Aware Neuromorphic Architecture for Efficient Skin Disease Classification on Resource-Constrained Devices”.
The paper’s co-authors are
Haitian Wang∗†, Xinyu Wang†, Yiren Wang†, Karen Lee†, Zichen Geng†, Xian Zhang†, Kehkashan Kiran∗, Yu Zhang∗†, Bo Miao‡
∗Northwestern Polytechnical University, Xi’an, Shaanxi 710129, China
†The University of Western Australia, Perth, WA 6009, Australia ‡Australian Institute for Machine Learning, University of Adelaide, SA 5005, Australia
“
V. CONCLUSION
In this paper, we proposed QANA, a quantization-aware neuromorphic framework for skin lesion classification on edge devices.
Extensive experiments on the large-scale HAM10000 benchmark and a real-world clinical dataset show that QANA achieves state-of-the-art accuracy (91.6% Top-1, 82.4% macro F1 on HAM10000; 90.8%/81.7% on the clinical set) while enabling real-time and energy-efficient inference on the BrainChip Akida platform (1.5 ms latency, 1.7 mJ per image). These results demonstrate that QANA is highly effective for portable medical analysis and AI deployment in dermatology under limited computing resources.
VI. ACKNOWLEDGEMENT
This research was supported by the National Natural Science Foundation of China (Nos. 62172336 and 62032018).
The authors gratefully acknowledge BrainChip Holdings Ltd. for providing technical support and the Akida AKD1000 hardware platform, whose powerful neuromorphic computing capabilities enabled strong performance of the SNN model. The authors also extend their appreciation to Dr. Atif Mansoor, Dr. Bo Miao and their teams for their preliminary contributions to this research.”
View attachment 88819
View attachment 88828
View attachment 88821
View attachment 88822
View attachment 88823
View attachment 88824
View attachment 88825
View attachment 88826
View attachment 88827
A Medium article inspired by the above paper:
Your Phone Could Soon Diagnose Skin Cancer — Thanks to a New Kind of AI
Bradley Susser
Follow
10 min read
·
4 hours ago
Consider receiving a highly accurate skin diagnosis instantly, right on a portable device, no matter your location, and with complete privacy. A recent study introduces QANA (Quantization-Aware Neuromorphic Architecture), an AI system built to achieve this, addressing key difficulties in obtaining dermatological care.
The Healthcare Access Crisis: By the Numbers
The dermatological care shortage represents one of healthcare’s most pressing areas of concern. According to the U.S. Department of Agriculture, rural communities comprise nearly 66% of primary care health professional shortage areas (HPSAs) in the country. This is due in large part to the fact that urban areas have 40 times the concentration of dermatologists per 100,000 citizens compared to rural areas. In Canada, there is a maldistribution of dermatologists, with as many as 5.6 dermatologists per 100,000 population in urban areas and as low as 0.6 per 100,000 in rural areas.
The Association of American Medical Colleges (AAMC) in its June 2021 study projected a shortage of up to 124,000 physicians by 2034. This includes a shortage of up to approximately 48,000 primary care physicians, but an even more severe shortage of up to 78,000 specialists.
Beyond geographic scarcity, access to timely and accurate skin cancer diagnosis also reveals racial disparities. While non-Hispanic Black individuals have lower incidence rates of melanoma than non-Hispanic White individuals (for instance, the lifetime risk of developing melanoma is approximately 1 in 1,000 for Black people compared to 1 in 38 for White people), Black patients are frequently diagnosed at a later, more advanced stage of the disease. This leads to appreciably poorer survival rates. For example, research indicates that Black melanoma patients have an estimated five-year survival rate of 70%, contrasted with 94% for White patients. Furthermore, studies show that 52% of non-Hispanic Black patients receive an initial diagnosis of advanced-stage melanoma, versus just 16% of non-Hispanic White patients. Such disparities are connected to elements like reduced public awareness of skin cancer risks in some communities and a lower index of suspicion among healthcare providers for skin cancer in individuals with darker skin tones, partly due to limited representation of diverse skin types in medical education materials.
A Real-World Scenario: When Distance Matters (Hypothetical Case Study)
Consider Samantha Fukes, a nurse practitioner working at a rural health clinic in Montana, 150 miles from the nearest dermatologist. When 68-year-old rancher Tom Miller arrives with a suspicious dark lesion on his neck that has changed shape over recent months, Samantha faces a familiar dilemma. Samatha’s choices were clear. She could direct Tom to drive three hours to see a specialist, or upload images to a cloud-based diagnostic system that might take days for results. Both paths posed considerable impediments.
With QANA-powered portable diagnostic technology, Samantha could capture a high-quality dermatoscopic image and receive an accurate diagnosis within 1.5 milliseconds, all while keeping Tom’s medical data securely on the device. This hypothetical scenario illustrates the transformative potential of edge-based AI diagnosis in addressing healthcare access disparities.
The Clinical Need for Portable Diagnostics
Skin diseases represent a notable diagnostic burden, particularly in settings where specialized dermatological expertise is unavailable. Conditions such as melanoma and Merkel cell carcinoma frequently face misdiagnosis when evaluated by clinicians without specialized training. While deep learning systems have demonstrated strong performance in dermatological diagnosis, conventional approaches require sensitive patient data to be transmitted to cloud servers for processing, raising substantial privacy concerns under regulations like HIPAA and GDPR.
The demand for portable diagnostic solutions extends beyond privacy considerations. Healthcare delivery in remote and home settings often lacks the infrastructure necessary for cloud-based analysis, creating a critical need for on-device diagnostic capabilities that can operate independently of internet connectivity.
Cloud vs. Edge: A Technology Comparison
When considering Artificial Intelligence (AI) solutions, two primary architectural approaches emerge:
Cloud-Based AI and
Edge-Based AI. Each offers distinct advantages and disadvantages across various features, making them suitable for different applications.
Data Privacy and Security
Cloud-Based AI typically involves uploading data to remote servers for processing. This introduces a
moderate level of data privacy, as information must traverse networks to reach the cloud. Consequently, it also presents
transmission vulnerabilities, increasing the data security risk during transit.
In contrast,
Edge-Based AI, such as QANA, prioritizes
high data privacybecause processing occurs directly on the device (“on-device”). This “contained on device” approach significantly reduces data security risks as information does not leave the local environment, eliminating transmission vulnerabilities.
Processing Speed and Latency
The
processing speed of Cloud-Based AI is
variable and heavily dependent on network connectivity and bandwidth. This variability can lead to
latencyranging from seconds to even minutes, as data travels to and from the cloud.
Conversely,
Edge-Based AI boasts
ultra-fast processing speeds, often achieving results in as little as 1.5 milliseconds locally. This leads to
consistent latency measured in milliseconds, making it ideal for applications requiring real-time responses.
Energy Consumption and Infrastructure
Cloud-Based AI typically incurs
high energy consumption due to the reliance on powerful GPUs and servers in data centers. It also has a
high infrastructure dependency, requiring robust internet connectivity and extensive cloud infrastructure to operate.
On the other hand,
Edge-Based AI is designed for
very low energy consumption, with some systems consuming as little as 1.7 millijoules per image. Its
minimal infrastructure dependency means it can function effectively with little to no external network connectivity.
Rural/Remote Usability
The reliance on internet connectivity for
Cloud-Based AI means its
rural/remote usability is limited. In areas with poor or no internet access, cloud-based solutions become impractical.
Conversely,
Edge-Based AI offers
high usability in rural and remote areasbecause it is
fully offline. This makes it a robust solution for environments where consistent internet access cannot be guaranteed.
Technical Innovation in Neural Architecture
QANA addresses these needs using a thorough four-stage process that includes data preparation, neural network creation, spike-based conversion, and hardware implementation. The architecture integrates several novel elements that set it apart from widely used methods.
The system begins with sophisticated data preprocessing that includes quality filtering, augmentation techniques, and Synthetic Minority Oversampling Technique (SMOTE) to address class imbalance common in medical datasets. This preprocessing stage ensures steadfast performance across diverse skin lesion types, including rare conditions that are typically underrepresented in training data.
The core neural architecture features a hierarchical design. It uses Ghost modules to improve its computational awareness. This essentially allows the system to learn more from less data, much like finding extra insights without needing extra effort. It also includes Spatially-Aware Efficient Channel Attention (SA-ECA) mechanisms and Squeeze-and-Excitation blocks. This combination enables the system to extract the most useful distinguishing features from images while remaining compatible with the specialized limits of neuromorphic hardware.
These Ghost modules form the basis for feature extraction. They employ both base and ghost convolutions to widen the range of data interpretation while keeping computational demands low. Similarly, the SA-ECA mechanism helps the system focus its attention. It captures connections between different data channels through lightweight processing, allowing it to model how information is related across space and channels with very little computational expense.
Neuromorphic Computing Advantages
Moving to Spiking Neural Networks (SNNs) signifies a core alteration from standard neural processing. In contrast to standard neural networks that process continuous values, SNNs utilize discrete spike events for information encoding and transmission. This method yields sparse, event-driven computation that greatly lessens energy use while preserving diagnostic accuracy.
The deployment platform, BrainChip’s Akida (ASX:BRN;OTC:BRCHF) neuromorphic processor, natively supports SNN operations and enables on-chip incremental learning. This capability allows the system to adapt to new patient data without requiring complete model retraining, aligning with clinical workflows that continuously encounter new diagnostic cases.
Spike-Compatible Architecture Design
The architecture incorporates specific design elements that facilitate seamless conversion from standard neural networks to spike-based processing. The spike-compatible feature transformation module employs separable convolutions with quantization-aware normalization, ensuring all activations remain within bounds suitable for spike encoding while preserving diagnostic information.
The Squeeze-and-Excitation blocks implement adaptive channel weighting through a two-stage bottleneck mechanism, providing additional regularization particularly beneficial for small, imbalanced medical datasets. The quantized output projection produces SNN-ready outputs that can be directly processed by neuromorphic hardware without additional conversion steps.
Comprehensive Performance Validation
Experimental validation was conducted on both the HAM10000 public benchmark dataset and a real-world clinical dataset from Hospital Sultanah Bahiyah, Malaysia. The clinical dataset comprised 3,162 dermatoscopic images from 1,235 patients, providing real-world validation beyond standard benchmarks.
On HAM10000, QANA achieved 91.6% Top-1 accuracy and 82.4% macro F1 score, maintaining comparable performance on the clinical dataset with 90.8% accuracy and 81.7% macro F1 score. These results demonstrate consistent performance across both standardized benchmarks and clinical practice conditions.
The system showed balanced performance across all seven diagnostic categories, including minority classes such as dermatofibroma and vascular lesions. Notably, melanoma detection achieved 95.6% precision and 93.3% recall, critical metrics for this potentially life-threatening condition.
Hardware Performance and Energy Analysis
When deployed on Akida hardware, the system delivers 1.5 millisecond inference latency and consumes only 1.7 millijoules of energy per image. These figures represent reductions of over 94.6% in inference latency and 98.6% in energy consumption compared to GPU-based CNN implementations.
Comparative analysis against state-of-the-art architectures converted to SNNs showed QANA’s superior performance across all metrics. While conventional architectures experienced accuracy drops of 3–7% after SNN conversion, QANA maintained high accuracy through its quantization-aware design principles.
Ablation Analysis and Component Contributions
Systematic ablation studies revealed the contribution of each architectural component. The Ghost blocks provided computational awareness, while ECA and SE modules contributed significantly to feature discrimination. The quantization-aware head and SMOTE preprocessing each added measurable performance improvements, with the complete system achieving optimal results through their synergistic combination.
Incremental learning capabilities demonstrated the system’s ability to adapt to new data without catastrophic forgetting, a critical requirement for clinical deployment where diagnostic patterns may evolve over time.
Clinical Implementation Considerations
The architecture’s design specifically addresses practical concerns in medical device deployment. The system operates effectively on 64×64 pixel images, accommodating current neuromorphic hardware memory constraints while maintaining sufficient resolution for diagnostic purposes. This resolution requirement aligns with practical constraints of portable diagnostic devices.
The quantization-aware design ensures minimal accuracy degradation during conversion to neuromorphic hardware, addressing a common issue where conventional architectures suffer significant performance loss when adapted for spike-based processing.
Expert Perspectives on Neuromorphic Healthcare Applications
The potential of neuromorphic computing in healthcare is gaining recognition among industry experts. Neuromorphic chips have the ability to outpace traditional computers in energy and space efficiency as well as performance, presenting substantial advantages across various domains, including artificial intelligence, health care and robotics, according to the scientists.
Over the short term, neuromorphic computing will likely be focused on adding AI capabilities to specialty edge devices in healthcare and defense applications, notes industry analysis. In healthcare, it enables real-time disease diagnosis, personalized drug discovery, and intelligent prosthetics through its ability to analyze large datasets and detect patterns.
Neuromorphic engineering, which utilizes neural models in hardware and software to mimic brain-like functions, offers the potential to transform medicine by providing energy-efficient, fast, compact, and high-performance solutions. The development of neural interfaces and brain-machine interfaces represents a growing area of medical application.
Implications for Healthcare Delivery
The development of QANA represents a considerable advancement toward democratizing access to dermatological diagnosis. By enabling accurate skin lesion classification on portable devices without requiring cloud connectivity, the system can support healthcare delivery in underserved regions and home-based care settings.
The privacy-preserving nature of the approach addresses growing concerns about medical data security while maintaining the diagnostic accuracy necessary for clinical decision-making. The low energy requirements and compact hardware footprint make the system suitable for integration into handheld diagnostic devices that can operate for extended periods without external power sources.
Beyond Dermatology
Potential Applications Across Medical Specialties
While the current work focuses on skin lesion classification, the architectural principles developed in QANA may be applicable to other medical imaging domains where edge deployment is desirable. The combination of quantization-aware design and neuromorphic deployment strategies provides a template for developing similar systems across various medical specialties.
Ophthalmology: Portable retinal screening devices could use QANA’s architecture to detect diabetic retinopathy, glaucoma, and age-related macular degeneration in remote clinics and developing countries where ophthalmologists are scarce.
Oral Health: Dental screening applications could identify early-stage oral cancers, periodontal disease, and other oral pathologies using smartphone-based imaging systems powered by neuromorphic processors.
Cancer Screening: The architecture could be adapted for various cancer screening applications, from cervical cancer detection using colposcopy images to lung nodule identification in portable X-ray systems.
Wound Assessment: Chronic wound monitoring in home healthcare settings could benefit from QANA-style systems that track healing progress and identify signs of infection without requiring specialist visits.
Market Adoption Challenges and Opportunities
The transition to neuromorphic-powered medical devices faces several considerations. Regulatory approval processes will need to adapt to evaluate AI systems that learn and evolve on-device. Healthcare providers will require training on new diagnostic workflows that integrate edge-based AI recommendations with clinical judgment.
However, the potential benefits are substantial. Reduced healthcare costs, improved access to specialist-level diagnostics, and enhanced patient privacy could drive rapid adoption once initial barriers are overcome.
Broader Applications and Versatility
The demonstrated success in handling class-imbalanced medical datasets through SMOTE integration and attention mechanisms suggests potential applications in other diagnostic areas where rare conditions require accurate detection with limited training data.
The study establishes a foundation for further research into privacy-preserving, energy-aware medical diagnostics that can operate effectively in resource-constrained environments while maintaining the accuracy standards necessary for clinical use. As neuromorphic hardware continues to mature, such approaches may become increasingly important for enabling distributed healthcare technologies that bring specialized diagnostic capabilities directly to patients.
The melding of neuromorphic computing and medical AI points toward truly portable, privacy-assuring diagnostic systems that could markedly alter healthcare provision in underserved communities globally.
Citation: Wang, H., Wang, X., Wang, Y., Lee, K., Geng, Z., Zhang, X., Kiran, K., Zhang, Y., & Miao, B. (2025). Quantization-Aware Neuromorphic Architecture for Efficient Skin Disease Classification on Resource-Constrained Devices. arXiv preprint arXiv:2507.15958.
https://doi.org/10.48550/arXiv.2507.15958
#AICancerDiagnosis,
#DermatologyTech,
#EdgeAI,
#HealthcareAccess,
#MedicalAI,
#MobileHealth,
#NeuromorphicComputing,
#PrivacyInHealthcare,
#RuralHealthcare,
#SkinHealthAI
Healthcare
Cancer
Technology
Medical
AI
https://medium.com/m/signin?actionU...----------------clap_footer------------------
Written by Bradley Susser
56 followers
·
560 following
Masters in Info Systems (Security & Assurance). Real Estate Professional. Ran a firm specializing in raising capital & investor relations for over a decade