title: A Comparative Analysis Towards Melanoma Classification Using Transfer Learning by Analyzing Dermoscopic Images

abstract: Melanoma is a sort of skin cancer that starts in the cells known as melanocytes. It is more dangerous than other types of skin cancer because it can spread to other organs. Melanoma can be fatal if it spreads to other parts of the body. Early detection is the key to cure, but it requires the skills of skilled doctors to diagnose it. This paper presents a system that combines deep learning techniques with established transfer learning methods to enable skin lesions classification and diagnosis of melanoma skin lesions. Using Convolutional Neural Networks, it presents a method for categorizing melanoma images into benign and malignant images in this research (CNNs). Researchers used 'Deep Learning' techniques to train an expansive number of photos & essentially to get the expected result deep neural networks to need to be trained with a huge number of parameters as dermoscopic images are sensitive & very hard to classify. This paper, has been emphasized building models with less complexity and comparatively better accuracy with limited datasets & partially fewer deep networks so that the system can predict Melanoma at ease from input dermoscopic images as correctly as possible within devices with less computational power. The dataset has been obtained from ISIC Archive. Multiple pre-trained models ResNet101, DenseNet, EfficientNet, InceptionV3 have been implemented using transfer learning techniques to complete the comparative analysis & every model achieved good accuracy. Before training the models, the data has been augmented by multiple parameters to improve the accuracy. Moreover, the results are better than the previous state-of-the-art approaches & adequate to predict melanoma. Among these architectures, DenseNet performed better than the others which gives a validation accuracy of 96.64%, validation loss of 9.43% & test set accuracy of 99.63%.


title: Recent Advances in Scalable Energy-Efficient and Trustworthy Spiking Neural networks: from Algorithms to Technology

abstract: Neuromorphic computing and, in particular, spiking neural networks (SNNs) have become an attractive alternative to deep neural networks for a broad range of signal processing applications, processing static and/or temporal inputs from different sensory modalities, including audio and vision sensors. In this paper, we start with a description of recent advances in algorithmic and optimization innovations to efficiently train and scale low-latency, and energy-efficient spiking neural networks (SNNs) for complex machine learning applications. We then discuss the recent efforts in algorithm-architecture co-design that explores the inherent trade-offs between achieving high energy-efficiency and low latency while still providing high accuracy and trustworthiness. We then describe the underlying hardware that has been developed to leverage such algorithmic innovations in an efficient way. In particular, we describe a hybrid method to integrate significant portions of the model's computation within both memory components as well as the sensor itself. Finally, we discuss the potential path forward for research in building deployable SNN systems identifying key challenges in the algorithm-hardware-application co-design space with an emphasis on trustworthiness.


title: Model-Based Sensor Diagnostics for Robotic Manipulators

abstract: Ensuring the safe and reliable operation of collaborative robots demands robust sensor diagnostics. This paper introduces a methodology for formulating model-based constraints tailored for sensor diagnostics, featuring analytical relationships extending across mechanical and electrical domains. While applicable to various robotic systems, the study specifically centers on a robotic joint employing a series elastic actuator. Three distinct constraints are imposed on the series elastic actuator: the Torsional Spring Constraint, Joint Dynamics Constraint, and Electrical Motor Constraint. Through a simulation example, we demonstrate the efficacy of the proposed model-based sensor diagnostics methodology. The study addresses two distinct types of sensor faults that may arise in the torque sensor of a robot joint, and delves into their respective detection methods. This insightful sensor diagnostic methodology is customizable and applicable across various components of robots, offering fault diagnostic and isolation capabilities. This research contributes valuable insights aimed at enhancing the diagnostic capabilities essential for the optimal performance of robotic manipulators in collaborative environments.


title: RNb-NeuS: Reflectance and Normal-based Multi-View 3D Reconstruction

abstract: This paper introduces a versatile paradigm for integrating multi-view reflectance (optional) and normal maps acquired through photometric stereo. Our approach employs a pixel-wise joint re-parameterization of reflectance and normal, considering them as a vector of radiances rendered under simulated, varying illumination. This re-parameterization enables the seamless integration of reflectance and normal maps as input data in neural volume rendering-based 3D reconstruction while preserving a single optimization objective. In contrast, recent multi-view photometric stereo (MVPS) methods depend on multiple, potentially conflicting objectives. Despite its apparent simplicity, our proposed approach outperforms state-of-the-art approaches in MVPS benchmarks across F-score, Chamfer distance, and mean angular error metrics. Notably, it significantly improves the detailed 3D reconstruction of areas with high curvature or low visibility.


title: Individual Behavioral Insights in Schizophrenia: A Network Analysis and Mobile Sensing Approach

abstract: Digital phenotyping in mental health often consists of collecting behavioral and experience-based information through sensory and self-reported data from devices such as smartphones. Such rich and comprehensive data could be used to develop insights into the relationships between daily behavior and a range of mental health conditions. However, current analytical approaches have shown limited application due to these datasets being both high dimensional and multimodal in nature. This study demonstrates the first use of a principled method which consolidates the complexities of subjective self-reported data (Ecological Momentary Assessments - EMAs) with concurrent sensor-based data. In this study the CrossCheck dataset is used to analyse data from 50 participants diagnosed with schizophrenia. Network Analysis is applied to EMAs at an individual (n-of-1) level while sensor data is used to identify periods of various behavioral context. Networks generated during periods of certain behavioral contexts, such as variations in the daily number of locations visited, were found to significantly differ from baseline networks and networks generated from randomly sampled periods of time. The framework presented here lays a foundation to reveal behavioural contexts and the concurrent impact of self-reporting at an n-of-1 level. These insights are valuable in the management of serious mental illnesses such as schizophrenia.


title: Understanding Opinions Towards Climate Change on Social Media

abstract: Social media platforms such as Twitter (now known as X) have revolutionized how the public engage with important societal and political topics. Recently, climate change discussions on social media became a catalyst for political polarization and the spreading of misinformation. In this work, we aim to understand how real world events influence the opinions of individuals towards climate change related topics on social media. To this end, we extracted and analyzed a dataset of 13.6 millions tweets sent by 3.6 million users from 2006 to 2019. Then, we construct a temporal graph from the user-user mentions network and utilize the Louvain community detection algorithm to analyze the changes in community structure around Conference of the Parties on Climate Change~(COP) events. Next, we also apply tools from the Natural Language Processing literature to perform sentiment analysis and topic modeling on the tweets. Our work acts as a first step towards understanding the evolution of pro-climate change communities around COP events. Answering these questions helps us understand how to raise people's awareness towards climate change thus hopefully calling on more individuals to join the collaborative effort in slowing down climate change.


title: A targeted search for FRB counterparts with Konus-Wind

abstract: We present results of the search for hard X-ray/soft $\gamma$-ray emission in coincidence with publicly reported (via Transient Name Server, TNS; http://www.wis-tns.org/) fast radio bursts (FRBs). The search was carried out using continuous Konus-Wind data with 2.944 s time resolution. We perform a targeted search for each individual burst from 581 FRBs, along with a stacking analysis of the bursts from 8 repeating sources in our sample and a separate stacking analysis of the bursts from the non-repeating FRBs. We find no significant associations in either case. We report upper bounds on the hard X-ray (20 - 1500 keV) flux assuming four spectral models, which generally describe spectra of short and long GRBs, magnetar giant flares, and the short burst, coincident with FRB 200428 from a Galactic magnetar. Depending on the spectral model, our upper bounds are in the range of $(0.1 - 2) \times10^{-6}$ erg cm$^{-2}$. For 18 FRBs with known distances we present upper bounds on the isotropic equivalent energy release and peak luminosity. For the nearest FRB 200120E, we derive the most stringent upper bounds of $E_{\text{iso}}\leq$2.0 $\times 10^{44}$ erg and $L_{\text{iso}}\leq$1.2 $\times 10^{44}$ erg s$^{-1}$. Furthermore, we report lower bounds on radio-to-gamma-ray fluence ratio $E_{\text{radio}}/E_{\text{iso}} \geq 10^{-11}-10^{-9}$ and compare our results with previously reported searches and theoretical predictions for high-energy counterparts to FRBs.


title: A Hierarchical Security Events Correlation Model for Real-time Cyber Threat Detection and Response

abstract: Intrusion detection systems perform post-compromise detection of security breaches whenever preventive measures such as firewalls do not avert an attack. However, these systems raise a vast number of alerts that must be analysed and triaged by security analysts. This process is largely manual, tedious and time-consuming. Alert correlation is a technique that tries to reduce the number of intrusion alerts by aggregating those that are related in some way. However, the correlation is performed outside the IDS through third-party systems and tools, after the high volume of alerts has already been raised. These other third-party systems add to the complexity of security operations. In this paper, we build on the very researched area of correlation techniques by developing a novel hierarchical event correlation model that promises to reduce the number of alerts issued by an Intrusion Detection System. This is achieved by correlating the events before the IDS classifies them. The proposed model takes the best of features from similarity and graph-based correlation techniques to deliver an ensemble capability not possible by either approach separately. Further, we propose a correlation process for correlation of events rather than alerts as is the case in current art. We further develop our own correlation and clustering algorithm which is tailor-made to the correlation and clustering of network event data. The model is implemented as a proof of concept with experiments run on the DARPA 99 Intrusion detection set. The correlation achieved 87 percent data reduction through aggregation, producing nearly 21000 clusters in about 30 seconds.


title: Boosting Object Detection with Zero-Shot Day-Night Domain Adaptation

abstract: Detecting objects in low-light scenarios presents a persistent challenge, as detectors trained on well-lit data exhibit significant performance degradation on low-light data due to low visibility. Previous methods mitigate this issue by exploring image enhancement or object detection techniques with real low-light image datasets. However, the progress is impeded by the inherent difficulties about collecting and annotating low-light images. To address this challenge, we propose to boost low-light object detection with zero-shot day-night domain adaptation, which aims to generalize a detector from well-lit scenarios to low-light ones without requiring real low-light data. Revisiting Retinex theory in the low-level vision, we first design a reflectance representation learning module to learn Retinex-based illumination invariance in images with a carefully designed illumination invariance reinforcement strategy. Next, an interchange-redecomposition-coherence procedure is introduced to improve over the vanilla Retinex image decomposition process by performing two sequential image decompositions and introducing a redecomposition cohering loss. Extensive experiments on ExDark, DARK FACE, and CODaN datasets show strong low-light generalizability of our method. Our code is available at https://github.com/ZPDu/DAI-Net.


title: Enabling Quantum Natural Language Processing for Hindi Language

abstract: Quantum Natural Language Processing (QNLP) is taking huge leaps in solving the shortcomings of classical Natural Language Processing (NLP) techniques and moving towards a more "Explainable" NLP system. The current literature around QNLP focuses primarily on implementing QNLP techniques in sentences in the English language. In this paper, we propose to enable the QNLP approach to HINDI, which is the third most spoken language in South Asia. We present the process of building the parameterized quantum circuits required to undertake QNLP on Hindi sentences. We use the pregroup representation of Hindi and the DisCoCat framework to draw sentence diagrams. Later, we translate these diagrams to Parameterised Quantum Circuits based on Instantaneous Quantum Polynomial (IQP) style ansatz. Using these parameterized quantum circuits allows one to train grammar and topic-aware sentence classifiers for the Hindi Language.


title: Phase portraits for quadratic systems possessing an infinite elliptic-saddle or an infinite nilpotent saddle

abstract: This paper presents a global study of the class $\bf{Q}{\widehat{ES}}$ of all real quadratic polynomial differential systems possessing exactly one elemental infinite singular point and one triple infinite singular point, which is either an infinite nilpotent elliptic-saddle or a nilpotent saddle. This class can be divided into three different families, namely, $\bf{Q}{{\widehat{ES}(A)}}$ of phase portraits possessing three real finite singular points, $\bf{Q}{{\widehat{ES}(B)}}$ of phase portraits possessing one real and two complex finite singular points, and $\bf{Q}{{\widehat{ES}(C)}}$ of phase portraits possessing one real triple finite singular point. Here we provide the complete study of the geometry of these three families. Modulo the action of the affine group and time homotheties, families $\bf{Q}{{\widehat{ES}(A)}}$ and $\bf{Q}{{\widehat{ES}(B)}}$ are three-dimensional and family $\bf{Q}{{\widehat{ES}(C)}}$ is two-dimensional. We study the respective bifurcation diagrams of their closures with respect to specific normal forms, in subsets of real Euclidean spaces. The bifurcation diagram of family $\bf{Q}{{\widehat{ES}(A)}}$ (respectively, $\bf{Q}{{\widehat{ES}(B)}}$ and $\bf{Q}{{\widehat{ES}(C)}}$) yields 1274 (respectively, 89 and 14) subsets with 91 (respectively, 27 and 12) topologically distinct phase portraits for systems in the closure $\overline{\bf{Q}{{\widehat{ES}(A)}}}$ (respectively, $\overline{\bf{Q}{{\widehat{ES}(B)}}}$ and $\overline{\bf{Q}{{\widehat{ES}(C)}}}$) within the representatives of $\bf{Q}{{\widehat{ES}(A)}}$ (respectively, $\bf{Q}{{\widehat{ES}(B)}}$ and $\bf{Q}{{\widehat{ES}(C)}}$) given by a specific normal form.


title: Saturation results around the Erd\H{o}s--Szekeres problem

abstract: In this paper, we consider saturation problems related to the celebrated Erd\H{o}s--Szekeres convex polygon problem. For each $n \ge 7$, we construct a planar point set of size $(7/8) \cdot 2^{n-2}$ which is saturated for convex $n$-gons. That is, the set contains no $n$ points in convex position while the addition of any new point creates such a configuration. This demonstrates that the saturation number is smaller than the Ramsey number for the Erd\H{o}s--Szekeres problem. The proof also shows that the original Erd\H{o}s--Szekeres construction is indeed saturated. Our construction is based on a similar improvement for the saturation version of the cups-versus-caps theorem. Moreover, we consider the generalization of the cups-versus-caps theorem to monotone paths in ordered hypergraphs. In contrast to the geometric setting, we show that this abstract saturation number is always equal to the corresponding Ramsey number.


title: $K_{\rm L}\rightarrow\mu^+\mu^-$ from lattice QCD

abstract: We propose a lattice-QCD-suitable framework for computing the two-photon long-distance contribution to the complex $K_{\rm L}\rightarrow\mu^+\mu^-$ decay amplitude, where QED is treated perturbatively in the continuum and infinite-volume. We provide preliminary numerical results on the quark-connected diagrams on one ensemble at physical pion mass from this method, with well-controlled systematic errors. The successful application of this method will allow the determination of the dispersive part of the aforementioned contribution from first-principles and enable a meaningful comparison between the Standard-Model prediction and experiment.


title: UCE-FID: Using Large Unlabeled, Medium Crowdsourced-Labeled, and Small Expert-Labeled Tweets for Foodborne Illness Detection

abstract: Foodborne illnesses significantly impact public health. Deep learning surveillance applications using social media data aim to detect early warning signals. However, labeling foodborne illness-related tweets for model training requires extensive human resources, making it challenging to collect a sufficient number of high-quality labels for tweets within a limited budget. The severe class imbalance resulting from the scarcity of foodborne illness-related tweets among the vast volume of social media further exacerbates the problem. Classifiers trained on a class-imbalanced dataset are biased towards the majority class, making accurate detection difficult. To overcome these challenges, we propose EGAL, a deep learning framework for foodborne illness detection that uses small expert-labeled tweets augmented by crowdsourced-labeled and massive unlabeled data. Specifically, by leveraging tweets labeled by experts as a reward set, EGAL learns to assign a weight of zero to incorrectly labeled tweets to mitigate their negative influence. Other tweets receive proportionate weights to counter-balance the unbalanced class distribution. Extensive experiments on real-world \textit{TWEET-FID} data show that EGAL outperforms strong baseline models across different settings, including varying expert-labeled set sizes and class imbalance ratios. A case study on a multistate outbreak of Salmonella Typhimurium infection linked to packaged salad greens demonstrates how the trained model captures relevant tweets offering valuable outbreak insights. EGAL, funded by the U.S. Department of Agriculture (USDA), has the potential to be deployed for real-time analysis of tweet streaming, contributing to foodborne illness outbreak surveillance efforts.


title: Global bifurcation for Paneitz type equations and constant Q-curvature metrics

abstract: We consider the Paneitz-type equation $\Delta^2 u -\alpha \Delta u +\beta (u-u^q ) =0$ on a closed Riemannian manifold $(M,g)$. We reduce the equation to a fourth-order ordinary differential equation assuming that $(M,g)$ admits a proper isoparametric function. Assuming that $\alpha$ and $\beta$ are positive and $\alpha^2 >4\beta$, we prove that the global nonconstant solutions of this ordinary differential equation only has nondegenerate critical points. Applying global bifurcation theory we prove multiplicity results for positive solutions of the equation. As an application and motivation we prove multiplicity results for conformal constant $Q$-curvature metrics. For example, consider closed positive Einstein manifolds $(M^n ,g )$ and $(X^m , h)$ of dimensions $n,m \geq 3$. Assuming that $M$ admits a proper isoparametric function (with a symmetry condition) we prove that as $\delta >0$ gets closer to 0, the number of constant $Q$-curvature metrics conformal to $g_{\delta} = g+\delta h$ goes to infinity.


title: Distributed Bayesian Estimation in Sensor Networks: Consensus on Marginal Densities

abstract: In this paper, we aim to design and analyze distributed Bayesian estimation algorithms for sensor networks. The challenges we address are to (i) derive a distributed provably-correct algorithm in the functional space of probability distributions over continuous variables, and (ii) leverage these results to obtain new distributed estimators restricted to subsets of variables observed by individual agents. This relates to applications such as cooperative localization and federated learning, where the data collected at any agent depends on a subset of all variables of interest. We present Bayesian density estimation algorithms using data from non-linear likelihoods at agents in centralized, distributed, and marginal distributed settings. After setting up a distributed estimation objective, we prove almost-sure convergence to the optimal set of pdfs at each agent. Then, we prove the same for a storage-aware algorithm estimating densities only over relevant variables at each agent. Finally, we present a Gaussian version of these algorithms and implement it in a mapping problem using variational inference to handle non-linear likelihood models associated with LiDAR sensing.


title: Mixed-Integer Optimisation of Graph Neural Networks for Computer-Aided Molecular Design

abstract: ReLU neural networks have been modelled as constraints in mixed integer linear programming (MILP), enabling surrogate-based optimisation in various domains and efficient solution of machine learning certification problems. However, previous works are mostly limited to MLPs. Graph neural networks (GNNs) can learn from non-euclidean data structures such as molecular structures efficiently and are thus highly relevant to computer-aided molecular design (CAMD). We propose a bilinear formulation for ReLU Graph Convolutional Neural Networks and a MILP formulation for ReLU GraphSAGE models. These formulations enable solving optimisation problems with trained GNNs embedded to global optimality. We apply our optimization approach to an illustrative CAMD case study where the formulations of the trained GNNs are used to design molecules with optimal boiling points.


title: Fast Commitment for Geo-Distributed Transactions via Decentralized Co-coordinators

abstract: In a geo-distributed database, data shards and their respective replicas are deployed in distinct datacenters across multiple regions, enabling regional-level disaster recovery and the ability to serve global users locally. However, transaction processing in geo-distributed databases requires multiple cross-region communications, especially during the commit phase, which can significantly impact system performance. To optimize the performance of geo-distributed transactions, we propose Decentralized Two-phase Commit (D2PC), a new transaction commit protocol aiming to minimize the negative impact of cross-region communication. In D2PC, we employ multiple co-coordinators that perform commit coordination in parallel. Each co-coordinator is responsible for collecting 2PC votes and making a PreCommit decision in its local region. This approach allows for the concurrent invocation of multiple cross-region network round trips, and each region can conclude its concurrency control locally before replication is complete, thus significantly reducing the chances of blocking and enhancing system concurrency. Moreover, we propose the bypass leader replication reply method, leveraging decentralized co-coordinators to bypass the leader for message transmission, thereby reducing the commit latency. Experimental results have demonstrated that D2PC can reduce commit latency by 43% and improve throughput by up to 2.43 times compared to the existing alternative geo-distributed transaction processing methods.


title: On containment of trace ideals in ideals of finite homological dimension

abstract: Motivated by recent result of P\'erez and R.G. on equality of test ideal of module closure operation and trace ideal, and the well-known result by Smith that parameter test ideal cannot be contained in parameter ideals, we study the obstruction of containment of trace ideals in ideals of finite projective (or injective) dimension. One of our results says that the trace ideal of any big Cohen--Macaulay module over a Gorenstein complete local domain cannot be contained in any ideal of finite projective dimension, thereby generalizing Smith's result in this case. As consequences of our results, we give upper bounds on $\mathfrak m$-adic order of trace ideals of certain modules over local Cohen--Macaulay rings. We also prove analogous results for ideal of entries of maps in a free resolution of modules.


title: Proposal to PAC 51: Color Transparency in Maximal Rescattering Kinematics

abstract: With the current highest beam energy at Jefferson Lab and traditional methods, we have exhausted our sensitivity for observing the onset of proton color transparency in a nucleus in A(e,e'p) parallel scattering kinematics for up to $Q^{2}$ = 14 GeV$^{2}$ . One of the disadvantages in A(e,e'p) experiments is that even if a point-like color singlet is produced at such $Q^{2}$, its expansion is unconstrained over the full radius of the nuclei, with the potential to significantly reduce the size of the color transparency effect. Therefore, in order to be sensitive to the effects of color transparency, we enhance the sensitivity of the measurement to the production of a point-like color neutral object prior to the onset of wave-function expansion. In this experiment, we propose a color transparency measurement in maximal rescattering ("dirty") kinematics in deuterium where final-state interactions (FSIs) are known to be huge effects, thereby enhancing our sensitivity to a reduction in FSIs indicative of color transparency. The kinematics in exclusive processes in deuterium can be precisely chosen such that the inter-nucleon distances of the struck and spectator nucleon lead to well-controlled FSIs.


title: A Comprehensive Study of Vision Transformers in Image Classification Tasks

abstract: Image Classification is a fundamental task in the field of computer vision that frequently serves as a benchmark for gauging advancements in Computer Vision. Over the past few years, significant progress has been made in image classification due to the emergence of deep learning. However, challenges still exist, such as modeling fine-grained visual information, high computation costs, the parallelism of the model, and inconsistent evaluation protocols across datasets. In this paper, we conduct a comprehensive survey of existing papers on Vision Transformers for image classification. We first introduce the popular image classification datasets that influenced the design of models. Then, we present Vision Transformers models in chronological order, starting with early attempts at adapting attention mechanism to vision tasks followed by the adoption of vision transformers, as they have demonstrated success in capturing intricate patterns and long-range dependencies within images. Finally, we discuss open problems and shed light on opportunities for image classification to facilitate new research ideas.


title: The Frobenious distances from projections to an idempotent matrix

abstract: For each pair of matrices $A$ and $B$ with the same order, let $\|A-B\|_F$ denote their Frobenius distance. This paper deals mainly with the Frobenius distances from projections to an idempotent matrix. For every idempotent $Q\in \mathbb{C}^{n\times n}$, a projection $m(Q)$ called the matched projection can be induced. It is proved that $m(Q)$ is the unique projection whose Frobenius distance away from $Q$ takes the minimum value among all the Frobenius distances from projections to $Q$, while $I_n-m(Q)$ is the unique projection whose Frobenius distance away from $Q$ takes the maximum value. Furthermore, it is proved that for every number $\alpha$ between the minimum value and the maximum value, there exists a projection $P$ whose Frobenius distance away from $Q$ takes the value $\alpha$. Based on the above characterization of the minimum distance, some Frobenius norm upper bounds and lower bounds of $\|P-Q\|_F$ are derived under the condition of $PQ=Q$ on a projection $P$ and an idempotent $Q$.


title: On the admissibility of Horvitz-Thompson estimator for estimating causal effects under network interference

abstract: The Horvitz-Thompson (H-T) estimator is widely used for estimating various types of average treatment effects under network interference. We systematically investigate the optimality properties of H-T estimator under network interference, by embedding it in the class of all linear estimators. In particular, we show that in presence of any kind of network interference, H-T estimator is in-admissible in the class of all linear estimators when using a completely randomized and a Bernoulli design. We also show that the H-T estimator becomes admissible under certain restricted randomization schemes termed as ``fixed exposure designs''. We give examples of such fixed exposure designs. It is well known that the H-T estimator is unbiased when correct weights are specified. Here, we derive the weights for unbiased estimation of various causal effects, and illustrate how they depend not only on the design, but more importantly, on the assumed form of interference (which in many real world situations is unknown at design stage), and the causal effect of interest.


title: Strategic Data Revocation in Federated Unlearning

abstract: By allowing users to erase their data's impact on federated learning models, federated unlearning protects users' right to be forgotten and data privacy. Despite a burgeoning body of research on federated unlearning's technical feasibility, there is a paucity of literature investigating the considerations behind users' requests for data revocation. This paper proposes a non-cooperative game framework to study users' data revocation strategies in federated unlearning. We prove the existence of a Nash equilibrium. However, users' best response strategies are coupled via model performance and unlearning costs, which makes the equilibrium computation challenging. We obtain the Nash equilibrium by establishing its equivalence with a much simpler auxiliary optimization problem. We also summarize users' multi-dimensional attributes into a single-dimensional metric and derive the closed-form characterization of an equilibrium, when users' unlearning costs are negligible. Moreover, we compare the cases of allowing and forbidding partial data revocation in federated unlearning. Interestingly, the results reveal that allowing partial revocation does not necessarily increase users' data contributions or payoffs due to the game structure. Additionally, we demonstrate that positive externalities may exist between users' data revocation decisions when users incur unlearning costs, while this is not the case when their unlearning costs are negligible.


title: Evetac: An Event-based Optical Tactile Sensor for Robotic Manipulation

abstract: Optical tactile sensors have recently become popular. They provide high spatial resolution, but struggle to offer fine temporal resolutions. To overcome this shortcoming, we study the idea of replacing the RGB camera with an event-based camera and introduce a new event-based optical tactile sensor called Evetac. Along with hardware design, we develop touch processing algorithms to process its measurements online at 1000 Hz. We devise an efficient algorithm to track the elastomer's deformation through the imprinted markers despite the sensor's sparse output. Benchmarking experiments demonstrate Evetac's capabilities of sensing vibrations up to 498 Hz, reconstructing shear forces, and significantly reducing data rates compared to RGB optical tactile sensors. Moreover, Evetac's output and the marker tracking provide meaningful features for learning data-driven slip detection and prediction models. The learned models form the basis for a robust and adaptive closed-loop grasp controller capable of handling a wide range of objects. We believe that fast and efficient event-based tactile sensors like Evetac will be essential for bringing human-like manipulation capabilities to robotics. The sensor design is open-sourced at https://sites.google.com/view/evetac .


title: PPAD-membership for Problems with Exact Rational Solutions: A General Approach via Convex Optimization

abstract: We introduce a general technique for proving membership of search problems with exact rational solutions in PPAD, one of the most well-known classes containing total search problems with polynomial-time verifiable solutions. In particular, we construct a "pseudogate", coined the linear-OPT-gate, which can be used as a "plug-and-play" component in a piecewise-linear (PL) arithmetic circuit, as an integral component of the "Linear-FIXP" equivalent definition of the class. The linear-OPT-gate can solve several convex optimization programs, including quadratic programs, which often appear organically in the simplest existence proofs for these problems. This effectively transforms existence proofs to PPAD-membership proofs, and consequently establishes the existence of solutions described by rational numbers. Using the linear-OPT-gate, we are able to significantly simplify and generalize almost all known PPAD-membership proofs for finding exact solutions in the application domains of game theory, competitive markets, auto-bidding auctions, and fair division, as well as to obtain new PPAD-membership results for problems in these domains.


title: A deep learning pipeline for cross-sectional and longitudinal multiview data integration

abstract: Biomedical research now commonly integrates diverse data types or views from the same individuals to better understand the pathobiology of complex diseases, but the challenge lies in meaningfully integrating these diverse views. Existing methods often require the same type of data from all views (cross-sectional data only or longitudinal data only) or do not consider any class outcome in the integration method, presenting limitations. To overcome these limitations, we have developed a pipeline that harnesses the power of statistical and deep learning methods to integrate cross-sectional and longitudinal data from multiple sources. Additionally, it identifies key variables contributing to the association between views and the separation among classes, providing deeper biological insights. This pipeline includes variable selection/ranking using linear and nonlinear methods, feature extraction using functional principal component analysis and Euler characteristics, and joint integration and classification using dense feed-forward networks and recurrent neural networks. We applied this pipeline to cross-sectional and longitudinal multi-omics data (metagenomics, transcriptomics, and metabolomics) from an inflammatory bowel disease (IBD) study and we identified microbial pathways, metabolites, and genes that discriminate by IBD status, providing information on the etiology of IBD. We conducted simulations to compare the two feature extraction methods. The proposed pipeline is available from the following GitHub repository: https://github.com/lasandrall/DeepIDA-GRU.


title: Motion Informed Needle Segmentation in Ultrasound Images

abstract: Segmenting a moving needle in ultrasound images is challenging due to the presence of artifacts, noise, and needle occlusion. This task becomes even more demanding in scenarios where data availability is limited. In this paper, we present a novel approach for needle segmentation for 2D ultrasound that combines classical Kalman Filter (KF) techniques with data-driven learning, incorporating both needle features and needle motion. Our method offers three key contributions. First, we propose a compatible framework that seamlessly integrates into commonly used encoder-decoder style architectures. Second, we demonstrate superior performance compared to recent state-of-the-art needle segmentation models using our novel convolutional neural network (CNN) based KF-inspired block, achieving a 15\% reduction in pixel-wise needle tip error and an 8\% reduction in length error. Third, to our knowledge we are the first to implement a learnable filter to incorporate non-linear needle motion for improving needle segmentation.


title: Observation of a drift-driven local transport regime in the island divertor of Wendelstein 7-X

abstract: Measurements of the poloidal electron density and temperature distribution in the W7-X island divertor reveal the existence of two distinct scrape-off layer transport regimes. At low and intermediate densities, $T_e$ profiles across the magnetic island are hollow, with a minimum at the island O-point. Above a threshold density $\overline{n}_e \approx 5 \times 10^{19}$ m$^{-3}$, the local minimum vanishes and the $T_e$ profiles become monotonic. At the lowest studied densities, the hollow $T_e$ profiles imply an electrostatic field of up to $\textbf{E}_r \sim 6$ kV/m, which can induce $\textbf{E} \times \textbf{B}$ drifts around the island, with drift velocities of up to $\sim3$ km/s. These $\textbf{E} \times \textbf{B}$ drifts result in strong convective heat transport poloidally around the island, binormal to the magnetic field, which supports the hollow radial temperature profile and hence provides a positive feedback to the electric field. Above the threshold density, these drifts strongly diminish, presumably due to increased anomalous diffusion, which causes the profile hollowness and therefore also the radial electric field to strongly diminish. This argument is supported by comparison to EMC3-EIRENE modeling and an analytical transport analyses showing that an additional, non-diffusive transport channel is required to maintain the profile hollowness up to the densities seen in experiment, and that a poloidal drift transport channel supports such hollowness only up to certain densities.


title: Just-in-Time Security Patch Detection -- LLM At the Rescue for Data Augmentation

abstract: In the face of growing vulnerabilities found in open-source software, the need to identify {discreet} security patches has become paramount. The lack of consistency in how software providers handle maintenance often leads to the release of security patches without comprehensive advisories, leaving users vulnerable to unaddressed security risks. To address this pressing issue, we introduce a novel security patch detection system, LLMDA, which capitalizes on Large Language Models (LLMs) and code-text alignment methodologies for patch review, data enhancement, and feature combination. Within LLMDA, we initially utilize LLMs for examining patches and expanding data of PatchDB and SPI-DB, two security patch datasets from recent literature. We then use labeled instructions to direct our LLMDA, differentiating patches based on security relevance. Following this, we apply a PTFormer to merge patches with code, formulating hybrid attributes that encompass both the innate details and the interconnections between the patches and the code. This distinctive combination method allows our system to capture more insights from the combined context of patches and code, hence improving detection precision. Finally, we devise a probabilistic batch contrastive learning mechanism within batches to augment the capability of the our LLMDA in discerning security patches. The results reveal that LLMDA significantly surpasses the start of the art techniques in detecting security patches, underscoring its promise in fortifying software maintenance.


title: DDxT: Deep Generative Transformer Models for Differential Diagnosis

abstract: Differential Diagnosis (DDx) is the process of identifying the most likely medical condition among the possible pathologies through the process of elimination based on evidence. An automated process that narrows a large set of pathologies down to the most likely pathologies will be of great importance. The primary prior works have relied on the Reinforcement Learning (RL) paradigm under the intuition that it aligns better with how physicians perform DDx. In this paper, we show that a generative approach trained with simpler supervised and self-supervised learning signals can achieve superior results on the current benchmark. The proposed Transformer-based generative network, named DDxT, autoregressively produces a set of possible pathologies, i.e., DDx, and predicts the actual pathology using a neural network. Experiments are performed using the DDXPlus dataset. In the case of DDx, the proposed network has achieved a mean accuracy of 99.82% and a mean F1 score of 0.9472. Additionally, mean accuracy reaches 99.98% with a mean F1 score of 0.9949 while predicting ground truth pathology. The proposed DDxT outperformed the previous RL-based approaches by a big margin. Overall, the automated Transformer-based DDx generative model has the potential to become a useful tool for a physician in times of urgency.


abstract: This is an expository paper which provides a quick introduction to Boolean inverse semigroups and their type monoids, with the emphasis on techniques and insights of the theory, and also treats the connection of the type monoid ${\mathrm{Typ}}(S)$ of a Boolean inverse semigroup $S$ with the monoid $V(K\langle S\rangle)$ of the ring $K\langle S\rangle$ assigned to $S$. We give original direct and simple proofs of some known results, such as the structure of semisimple Boolean inverse semigroups, the presentation of the type monoid by generalized rook matrices. We also prove that the type monoid of the tight Booleanization of a graph inverse semigroup is isomorphic to the graph monoid of this semigroup.


title: Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2023): Workshop and Shared Task Report

abstract: We provide a summary of the sixth edition of the CASE workshop that is held in the scope of RANLP 2023. The workshop consists of regular papers, three keynotes, working papers of shared task participants, and shared task overview papers. This workshop series has been bringing together all aspects of event information collection across technical and social science fields. In addition to contributing to the progress in text based event extraction, the workshop provides a space for the organization of a multimodal event information collection task.


title: The Holomorphic Extension Property for $k$-du Bois Singularities

abstract: Let $X$ be a normal complex variety and $\pi:\tilde X \to X$ a resolution of singularities. We show that the inclusion morphism $\pi_*\Omega_{\tilde X}^p\hookrightarrow \Omega_X^{[p]}$ is an isomorphism for $p < \mathrm{codim}_X(X_{\mathrm{sing}})$ when $X$ has du Bois singularities, giving an improvement on Flenner's criterion for arbitrary singularities. We also study the $k$-du Bois definition from the perspective of holomorphic extension and compare how different restrictions on $\mathscr H^0(\underline \Omega_X^p)$ affect the singularities of $X$, where $\underline\Omega_X^p$ is the $p^{th}$-graded piece of the du Bois complex.


title: Co-Designed Superconducting Architecture for Lattice Surgery of Surface Codes with Quantum Interface Routing Card

abstract: Facilitating the ability to achieve logical qubit error rates below physical qubit error rates, error correction is anticipated to play an important role in scaling quantum computers. While many algorithms require millions of physical qubits to be executed with error correction, current superconducting qubit systems contain only hundreds of physical qubits. One of the most promising codes on the superconducting qubit platform is the surface code, requiring a realistically attainable error threshold and the ability to perform universal fault-tolerant quantum computing with local operations via lattice surgery and magic state injection. Surface code architectures easily generalize to single-chip planar layouts, however space and control hardware constraints point to limits on the number of qubits that can fit on one chip. Additionally, the planar routing on single-chip architectures leads to serialization of commuting gates and strain on classical decoding caused by large ancilla patches. A distributed multi-chip architecture utilizing the surface code can potentially solve these problems if one can optimize inter-chip gates, manage collisions in networking between chips, and minimize routing hardware costs. We propose QuIRC, a superconducting Quantum Interface Routing Card for Lattice Surgery between surface code modules inside of a single dilution refrigerator. QuIRC improves scaling by allowing connection of many modules, increases ancilla connectivity of surface code lattices, and offers improved transpilation of Pauli-based surface code circuits. QuIRC employs in-situ Entangled Pair (EP) generation protocols for communication. We explore potential topological layouts of QuIRC based on superconducting hardware fabrication constraints, and demonstrate reductions in ancilla patch size by up to 77.8%, and in layer transpilation size by 51.9% when compared to the single-chip case.


title: Chaos for generalized Black-Scholes equations

abstract: The Nobel Prize winning Black-Scholes equation for stock options and the heat equation can both be written in the form \[ \frac{\partial u}{\partial t}=P_2(A)u, \] where $P_2(z)=\alpha z^2+ \beta z+\gamma$ is a quadratic polynomial with $\alpha > 0$. In fact, taking $A = x\frac{\partial}{\partial x}$ on functions on $[0,\infty) \times [0,\infty)$ the previous equality reduces to the Black-Scholes equation, while taking $A = \frac{\partial}{\partial x}$ for functions on $\mathbb{R} \times [0,\infty)$ it becomes the heat equation. Here, we ``connect'' the two previous problems by considering the generalized operator $A= x^a\frac{\partial}{\partial x}$ for functions on $[0,\infty) \times [0,\infty)$ with $0<a<1$, and our main result is that the corresponding degenerate parabolic equation is governed by a semigroup of operators which is chaotic on a class of Banach spaces. The relevant Banach spaces are weighted supremum norm spaces of continuous functions on $[0,\infty)$. This paper unifies, simplifies and significantly extends earlier results obtained for the Black-Scholes equation ($a=1$) in \cite{EGG} and the heat equation ($a=0$) in \cite{EGG1}.


title: Random projections beyond zero overlap

abstract: A random vector whose norm and overlap (inner product with an independent copy) concentrates is shown to have random low-dimensional projections that are approximately random Gaussians. Conversely, asymptotically random Gaussian projections imply these hypotheses. This extends and unites several existing results in geometric functional analysis and spin glasses. Applications include a large-system characterization of the joint law of cavity fields in the Sherrington-Kirkpatrick model.


title: A Multifidelity Sim-to-Real Pipeline for Verifiable and Compositional Reinforcement Learning

abstract: We propose and demonstrate a compositional framework for training and verifying reinforcement learning (RL) systems within a multifidelity sim-to-real pipeline, in order to deploy reliable and adaptable RL policies on physical hardware. By decomposing complex robotic tasks into component subtasks and defining mathematical interfaces between them, the framework allows for the independent training and testing of the corresponding subtask policies, while simultaneously providing guarantees on the overall behavior that results from their composition. By verifying the performance of these subtask policies using a multifidelity simulation pipeline, the framework not only allows for efficient RL training, but also for a refinement of the subtasks and their interfaces in response to challenges arising from discrepancies between simulation and reality. In an experimental case study we apply the framework to train and deploy a compositional RL system that successfully pilots a Warthog unmanned ground robot.


title: Constructing maximal pipedreams of double Grothendieck polynomials

abstract: Pechenik, Speyer and Weigandt defined a statistic $\mathsf{rajcode}(\cdot)$ on permutations which characterizes the leading monomial in top degree components of double Grothendieck polynomials. Their proof is combinatorial: They showed there exists a unique pipedream of a permutation $w$ with row weight $\mathsf{rajcode}(w)$ and column weight $\mathsf{rajcode}(w^{-1})$. They proposed the problem of finding a ``direct recipe'' for this pipedream. We solve this problem by providing an algorithm that constructs this pipedream via ladder moves.


title: Stochastic Resource Allocation via Dual Tail Waterfilling

abstract: Optimal resource allocation in wireless systems still stands as a rather challenging task due to the inherent statistical characteristics of channel fading. On the one hand, minimax/outage-optimal policies are often overconservative and analytically intractable, despite advertising maximally reliable system performance. On the other hand, ergodic-optimal resource allocation policies are often susceptible to the statistical dispersion of heavy-tailed fading channels, leading to relatively frequent drastic performance drops. We investigate a new risk-aware formulation of the classical stochastic resource allocation problem for point-to-point power-constrained communication networks over fading channels with no cross-interference, by leveraging the Conditional Value-at-Risk (CV@R) as a coherent measure of risk. We rigorously derive closed-form expressions for the CV@R-optimal risk-aware resource allocation policy, as well as the optimal associated quantiles of the corresponding user rate functions by capitalizing on the underlying fading distribution, parameterized by dual variables. We then develop a purely dual tail waterfilling scheme, achieving significantly more rapid and assured convergence of dual variables, as compared with the primal-dual tail waterfilling algorithm, recently proposed in the literature. The effectiveness of the proposed scheme is also readily confirmed via detailed numerical simulations.


title: On Steiner Trees of the Regular Simplex

abstract: In the Euclidean Steiner Tree problem, we are given as input a set of points (called terminals) in the $\ell_2$-metric space and the goal is to find the minimum-cost tree connecting them. Additional points (called Steiner points) from the space can be introduced as nodes in the solution. The seminal works of Arora [JACM'98] and Mitchell [SICOMP'99] provide a Polynomial Time Approximation Scheme (PTAS) for solving the Euclidean Steiner Tree problem in fixed dimensions. However, the problem remains poorly understood in higher dimensions (such as when the dimension is logarithmic in the number of terminals) and ruling out a PTAS for the problem in high dimensions is a notoriously long standing open problem (for example, see Trevisan [SICOMP'00]). Moreover, the explicit construction of optimal Steiner trees remains unknown for almost all well-studied high-dimensional point configurations. Furthermore, a vast majority the state-of-the-art structural results on (high-dimensional) Euclidean Steiner trees were established in the 1960s, with no noteworthy update in over half a century. In this paper, we revisit high-dimensional Euclidean Steiner trees, proving new structural results. We also establish a link between the computational hardness of the Euclidean Steiner Tree problem and understanding the optimal Steiner trees of regular simplices (and simplicial complexes), proposing several conjectures and showing that some of them suffice to resolve the status of the inapproximability of the Euclidean Steiner Tree problem. Motivated by this connection, we investigate optimal Steiner trees of regular simplices, proving new structural properties of their optimal Steiner trees, revisiting an old conjecture of Smith [Algorithmica'92] about their optimal topology, and providing the first explicit, general construction of candidate optimal Steiner trees for that topology.


title: On Merits of Faster-than-Nyquist Signaling in the Finite Blocklength Regime

abstract: We identify potential merits of faster-than-Nyquist (FTN) signaling in the finite blocklength (FBL) regime. A unique aspect of FTN signaling is that it can increase the blocklength by packing more data symbols within the same time and frequency to yield strictly higher number of independent signaling dimensions than that of Nyquist rate signaling. Using the finite-blocklength information theory, we provide tight bounds on the maximum channel coding rate (MCCR) of FTN signaling for any finite time-bandwidth product. The merits are categorized into two operating regions of FTN, i.e., when the time-acceleration factor of FTN, $\tau$, is above or below a certain threshold $\tau_{0}$. When $\tau > \tau_{0}$, FTN has both higher channel capacity and MCCR than that of Nyquist rate signaling, when the utilized pulse shape is non-sinc. Since the issues associated with the ideal sinc pulse only get exacerbated when packets are short, the benefit of FTN becomes more significant in the FBL regime. On the other hand, when $\tau < \tau_{0}$, the channel capacity is fixed but MCCR of FTN can continue to increase to a certain degree, thereby reducing the gap between the capacity and MCCR. This benefit is present regardless of the utilized pulse shape, including the ideal sinc-pulse, and is unique to the FBL regime. Instead of increasing MCCR for fixed block error rates, FTN can alternatively lower the block error rates for fixed channel coding rates. These results imply that FTN can lower the penalty from limited channel coding over short blocklength and can improve the performance and reliability of short packet communications.


title: Notes in the isometric deformations problem in codimension 2

abstract: We present a discussion about the local isometric rigidity problem in codimension 2 with a concrete example. We show the necessity of extending the notions of genuine and honest rigidity in order to have the transitivity property. In order to do so, we show the necessity of studying the isometric immersions in semi-Euclidean spaces. We show that this extension comes with a natural type of singularity in the inner product.


title: Meta ControlNet: Enhancing Task Adaptation via Meta Learning

abstract: Diffusion-based image synthesis has attracted extensive attention recently. In particular, ControlNet that uses image-based prompts exhibits powerful capability in image tasks such as canny edge detection and generates images well aligned with these prompts. However, vanilla ControlNet generally requires extensive training of around 5000 steps to achieve a desirable control for a single task. Recent context-learning approaches have improved its adaptability, but mainly for edge-based tasks, and rely on paired examples. Thus, two important open issues are yet to be addressed to reach the full potential of ControlNet: (i) zero-shot control for certain tasks and (ii) faster adaptation for non-edge-based tasks. In this paper, we introduce a novel Meta ControlNet method, which adopts the task-agnostic meta learning technique and features a new layer freezing design. Meta ControlNet significantly reduces learning steps to attain control ability from 5000 to 1000. Further, Meta ControlNet exhibits direct zero-shot adaptability in edge-based tasks without any finetuning, and achieves control within only 100 finetuning steps in more complex non-edge tasks such as Human Pose, outperforming all existing methods. The codes is available in https://github.com/JunjieYang97/Meta-ControlNet.


title: Breaking XOR Arbiter PUFs without Reliability Information

abstract: Unreliable XOR Arbiter PUFs were broken by a machine learning attack, which targets the underlying Arbiter PUFs individually. However, reliability information from the PUF was required for this attack. We show that, for the first time, a perfectly reliable XOR Arbiter PUF, where no reliability information is accessible, can be efficiently attacked in the same divide-and-conquer manner. Our key insight is that the responses of correlated challenges also reveal their distance to the decision boundary. This leads to a chosen challenge attack on XOR Arbiter PUFs. The effectiveness of our attack is confirmed through PUF simulation and FPGA implementation.


title: Directing entanglement spreading by means of a quantum East/West heterojunction structure

abstract: We extend the translationally invariant quantum East model to an inhomogeneous chain with East/West heterojunction structure. In analogy to the quantum diffusion of substantial particles, we observe a cyclic entanglement entropy spreading in the heterojunction during time evolution, which can be regarded as continuous cycles in a quantum heat engine. In order to figure out the possibility of manipulating the entanglement entropy as a quantum resource, the entropy growth is shown to be determined by the initial occupation and the site-dependent chemical potential, and the former is equivalent to an effective temperature. Through fine adjustment of these parameters, we discover the entanglement flow is simply superposed with those from two sources of the chain. An intriguing relation between our model and the traditional heat engines is subsequently established.


title: Could the TeV emission of starburst galaxies originate from pulsar wind nebulae?

abstract: While the GeV $\gamma$-ray emission of starburst galaxies (SBG) is commonly thought to arise from hadronic interactions between accelerated cosmic rays and interstellar gas, the origin of the TeV $\gamma$-ray emission is more uncertain. One possibility is that a population of pulsar wind nebulae (PWNe) in these galaxies could be responsible for the TeV $\gamma$-ray emission. In this work, we first synthesize a PWNe population in the Milky Way, and assessed their contribution to the $\gamma$-ray emission of the Galaxy, using a time-dependent model to calculate the evolution of the PWN population. Such synthetic PWN population can reproduce the flux distribution of identified PWNe in the Milky Way given a distribution of the initial state of the pulsar population. We then apply it to starburst galaxies and quantitatively calculate the spectral energy distribution of all PWNe in the SBG NGC 253 and M82. We propose that TeV $\gamma$-ray emission in starburst galaxies can be dominated by PWNe for a wide range of parameter space. The energetic argument requires that $\eta_e \times v_{\rm SN} > 0.01 {\rm yr}^{-1}$, where $\eta_e$ is the fraction the spin-down energy going to electrons and $v_{\rm SN}$ is the supernova rate. By requiring the synchrotron emission flux of all PWNe in the galaxy not exceeding the hard X-ray measurement of NGC 253, we constrain the initial magnetic field strength of PWNe to be $< 400 \mu$G. Future observations at higher energies with LHAASO or next-generation neutrino observatory IceCube-Gen2 will help us to understand better the origin of the TeV $\gamma$-ray emission in SBGs.


title: Topological defect formation in a phase transition with tunable order

abstract: The Kibble-Zurek mechanism (KZM) describes the non-equilibrium dynamics and topological defect formation in systems undergoing second-order phase transitions. KZM has found applications in fields such as cosmology and condensed matter physics. However, it is generally not suitable for describing first-order phase transitions. It has been demonstrated that transitions in systems like superconductors or charged superfluids, typically classified as second-order, can exhibit weakly first-order characteristics when the influence of fluctuations is taken into account. Moreover, the order of the phase transition (i.e., the extent to which it becomes first rather than second order) can be tuned. We explore quench-induced formation of topological defects in such tunable phase transitions and propose that their density can be predicted by combining KZM with nucleation theory.

categories: cond-mat.stat-mech gr-qc hep-ph hep-th quant-ph


title: Rethinking PGD Attack: Is Sign Function Necessary?

abstract: Neural networks have demonstrated success in various domains, yet their performance can be significantly degraded by even a small input perturbation. Consequently, the construction of such perturbations, known as adversarial attacks, has gained significant attention, many of which fall within "white-box" scenarios where we have full access to the neural network. Existing attack algorithms, such as the projected gradient descent (PGD), commonly take the sign function on the raw gradient before updating adversarial inputs, thereby neglecting gradient magnitude information. In this paper, we present a theoretical analysis of how such sign-based update algorithm influences step-wise attack performance, as well as its caveat. We also interpret why previous attempts of directly using raw gradients failed. Based on that, we further propose a new raw gradient descent (RGD) algorithm that eliminates the use of sign. Specifically, we convert the constrained optimization problem into an unconstrained one, by introducing a new hidden variable of non-clipped perturbation that can move beyond the constraint. The effectiveness of the proposed RGD algorithm has been demonstrated extensively in experiments, outperforming PGD and other competitors in various settings, without incurring any additional computational overhead. The codes is available in https://github.com/JunjieYang97/RGD.


title: TIBET: Identifying and Evaluating Biases in Text-to-Image Generative Models

abstract: Text-to-Image (TTI) generative models have shown great progress in the past few years in terms of their ability to generate complex and high-quality imagery. At the same time, these models have been shown to suffer from harmful biases, including exaggerated societal biases (e.g., gender, ethnicity), as well as incidental correlations that limit such model's ability to generate more diverse imagery. In this paper, we propose a general approach to study and quantify a broad spectrum of biases, for any TTI model and for any prompt, using counterfactual reasoning. Unlike other works that evaluate generated images on a predefined set of bias axes, our approach automatically identifies potential biases that might be relevant to the given prompt, and measures those biases. In addition, our paper extends quantitative scores with post-hoc explanations in terms of semantic concepts in the images generated. We show that our method is uniquely capable of explaining complex multi-dimensional biases through semantic concepts, as well as the intersectionality between different biases for any given prompt. We perform extensive user studies to illustrate that the results of our method and analysis are consistent with human judgements.


title: A Review and A Robust Framework of Data-Efficient 3D Scene Parsing with Traditional/Learned 3D Descriptors

abstract: Existing state-of-the-art 3D point cloud understanding methods merely perform well in a fully supervised manner. To the best of our knowledge, there exists no unified framework that simultaneously solves the downstream high-level understanding tasks including both segmentation and detection, especially when labels are extremely limited. This work presents a general and simple framework to tackle point cloud understanding when labels are limited. The first contribution is that we have done extensive methodology comparisons of traditional and learned 3D descriptors for the task of weakly supervised 3D scene understanding, and validated that our adapted traditional PFH-based 3D descriptors show excellent generalization ability across different domains. The second contribution is that we proposed a learning-based region merging strategy based on the affinity provided by both the traditional/learned 3D descriptors and learned semantics. The merging process takes both low-level geometric and high-level semantic feature correlations into consideration. Experimental results demonstrate that our framework has the best performance among the three most important weakly supervised point clouds understanding tasks including semantic segmentation, instance segmentation, and object detection even when very limited number of points are labeled. Our method, termed Region Merging 3D (RM3D), has superior performance on ScanNet data-efficient learning online benchmarks and other four large-scale 3D understanding benchmarks under various experimental settings, outperforming current arts by a margin for various 3D understanding tasks without complicated learning strategies such as active learning.


title: Gate-Tunable Berry Curvature Dipole Polarizability in Dirac Semimetal Cd3As2

abstract: We reveal the gate-tunable Berry curvature dipole polarizability in Dirac semimetal Cd3As2 nanoplates through measurements of the third-order nonlinear Hall effect. Under an applied electric field, the Berry curvature exhibits an asymmetric distribution, forming a field-induced Berry curvature dipole, resulting in a measurable third-order Hall voltage with a cubic relationship to the longitudinal electric field. Notably, the magnitude and polarity of this third-order nonlinear Hall effect can be effectively modulated by gate voltages. Furthermore, our scaling relation analysis demonstrates that the sign of the Berry curvature dipole polarizability changes when tuning the Fermi level across the Dirac point, in agreement with theoretical calculations. The results highlight the gate control of nonlinear quantum transport in Dirac semimetals, paving the way for promising advancements in topological electronics.


title: Zeros of the Goss zeta function

abstract: Let $X$ be a smooth proper curve over a finite field and let $\infty \in X$ be a closed point. Let $A$ be the ring of functions on $X - \infty$. The Goss zeta function $\zeta_A$ of $A$ is an equicharacteristic analogue of the Riemann zeta function. In this article we study the zeros of $\zeta_A$ under the generic condition that $X$ is ordinary. We prove an analogue of the Riemann hypothesis, which verifies a corrected version of a conjecture of Goss. We also show that the zeros of $\zeta_A$ at negative even integers are `simple' and that $\zeta_A$ is nonzero at negative odd integers. This answers questions posed by Goss and Thakur. Both of these results were previously only known under the restrictive hypothesis that $A$ has class number one. Finally, we prove versions of these results for $v$-adic interpolations of the Goss zeta function.


title: Concentration of Randomized Functions of Uniformly Bounded Variation

abstract: A sharp, distribution free, non-asymptotic result is proved for the concentration of a random function around the mean function, when the randomization is generated by a finite sequence of independent data and the random functions satisfy uniform bounded variation assumptions. The specific motivation for the work comes from the need for inference on the distributional impacts of social policy intervention. However, the family of randomized functions that we study is broad enough to cover wide-ranging applications. For example, we provide a Kolmogorov-Smirnov like test for randomized functions that are almost surely Lipschitz continuous, and novel tools for inference with heterogeneous treatment effects. A Dvoretzky-Kiefer-Wolfowitz like inequality is also provided for the sum of almost surely monotone random functions, extending the famous non-asymptotic work of Massart for empirical cumulative distribution functions generated by i.i.d. data, to settings without micro-clusters proposed by Canay, Santos, and Shaikh. We illustrate the relevance of our theoretical results for applied work via empirical applications. Notably, the proof of our main concentration result relies on a novel stochastic rendition of the fundamental result of Debreu, generally dubbed the "gap lemma," that transforms discontinuous utility representations of preorders into continuous utility representations, and on an envelope theorem of an infinite dimensional optimisation problem that we carefully construct.


title: A unified framework for covariate adjustment under stratified randomization

abstract: Randomization, as a key technique in clinical trials, can eliminate sources of bias and produce comparable treatment groups. In randomized experiments, the treatment effect is a parameter of general interest. Researchers have explored the validity of using linear models to estimate the treatment effect and perform covariate adjustment and thus improve the estimation efficiency. However, the relationship between covariates and outcomes is not necessarily linear, and is often intricate. Advances in statistical theory and related computer technology allow us to use nonparametric and machine learning methods to better estimate the relationship between covariates and outcomes and thus obtain further efficiency gains. However, theoretical studies on how to draw valid inferences when using nonparametric and machine learning methods under stratified randomization are yet to be conducted. In this paper, we discuss a unified framework for covariate adjustment and corresponding statistical inference under stratified randomization and present a detailed proof of the validity of using local linear kernel-weighted least squares regression for covariate adjustment in treatment effect estimators as a special case. In the case of high-dimensional data, we additionally propose an algorithm for statistical inference using machine learning methods under stratified randomization, which makes use of sample splitting to alleviate the requirements on the asymptotic properties of machine learning methods. Finally, we compare the performances of treatment effect estimators using different machine learning methods by considering various data generation scenarios, to guide practical research.


title: Distributed Reinforcement Learning for Molecular Design: Antioxidant case

abstract: Deep reinforcement learning has successfully been applied for molecular discovery as shown by the Molecule Deep Q-network (MolDQN) algorithm. This algorithm has challenges when applied to optimizing new molecules: training such a model is limited in terms of scalability to larger datasets and the trained model cannot be generalized to different molecules in the same dataset. In this paper, a distributed reinforcement learning algorithm for antioxidants, called DA-MolDQN is proposed to address these problems. State-of-the-art bond dissociation energy (BDE) and ionization potential (IP) predictors are integrated into DA-MolDQN, which are critical chemical properties while optimizing antioxidants. Training time is reduced by algorithmic improvements for molecular modifications. The algorithm is distributed, scalable for up to 512 molecules, and generalizes the model to a diverse set of molecules. The proposed models are trained with a proprietary antioxidant dataset. The results have been reproduced with both proprietary and public datasets. The proposed molecules have been validated with DFT simulations and a subset of them confirmed in public "unseen" datasets. In summary, DA-MolDQN is up to 100x faster than previous algorithms and can discover new optimized molecules from proprietary and public antioxidants.


title: Persistent Mayer homology and persistent Mayer Laplacian

abstract: In algebraic topology, the differential (i.e., boundary operator) typically satisfies $d^{2}=0$. However, the generalized differential $d^{N}=0$ for an integer $N\geq 2$ has been studied in terms of Mayer homology on $N$-chain complexes for more than eighty years. We introduce Mayer Laplacians on $N$-chain complexes. We show that both Mayer homology and Mayer Laplacians offer considerable application potential, providing topological and geometric insights to spaces. We also introduce persistent Mayer homology and persistent Mayer Laplacians at various $N$. The Wasserstein distance and stability of persistence diagrams associated with Mayer homology are investigated. Our computational experiments indicate that the topological features offered by persistent Mayer homology and spectrum given by persistent Mayer Laplacians hold substantial promise for large, complex, and diverse data. We envision that the present work serves as an inaugural step towards integrating Mayer homology and Mayer Laplacians into the realm of topological data analysis.


title: Room-temperature orbit-transfer torque enabling van der Waals magnetoresistive memories

abstract: The nonvolatile magnetoresistive random access memory (MRAM) is believed to facilitate emerging applications, such as in memory computing, neuromorphic computing and stochastic computing. Two dimensional (2D) materials and their van der Waals heterostructures promote the development of MRAM technology, due to their atomically smooth interfaces and tunable physical properties. Here we report the all-2D magnetoresistive memories featuring all electrical data reading and writing at room temperature based on WTe2/Fe3GaTe2/BN/Fe3GaTe2 heterostructures. The data reading process relies on the tunnel magnetoresistance of Fe3GaTe2/BN/Fe3GaTe2. The data writing is achieved through current induced polarization of orbital magnetic moments in WTe2, which exert torques on Fe3GaTe2, known as the orbit transfer torque (OTT) effect. In contrast to the conventional reliance on spin moments in spin transfer torque and spin orbit torque, the OTT effect leverages the natural out of plane orbital moments, facilitating field-free perpendicular magnetization switching through interface currents. Our results indicate that the emerging OTT MRAM is promising for low power, high performance memory applications.


title: Raman fingerprints of spin-phonon coupling and magnetic transition in an organic molecule intercalated Cr2Ge2Te6

abstract: The manipulation of spin-phonon coupling in both formations and explorations of magnetism in two-dimensional van der Waals ferromagnetic semiconductors facilitates unprecedented prospects for spintronics devices. The interlayer engineering tunes spin-phonon coupling significantly and holds the promise for controllable magnetism via organic cation intercalation. Here, we present spectroscopic evidence to reveal the intercalation effect on intrinsic magnetic and electronic transitions in quasi-two-dimensional Cr2Ge2Te6 using tetrabutyl ammonium as the intercalant. The temperature-evolution of Raman modes E_g^3 and A_g^1, along with the magnetization measurements, unambiguously captures the enhancement of the ferromagnetic Curie temperature in the intercalated heterostructure. Moreover, the E_g^4 mode highlighted the increased effect of spin-phonon interaction in magnetic order-induced lattice distortion. Combined with the first-principle calculations, we observed a substantial number of electrons transferred from TBA+ to Cr through the interface. These results provide the interplay between spin-phonon coupling and magnetic ordering in van der Waals magnets where Raman fingerprints would be highly beneficial for further understanding the manipulation of magnetism in layered heterostructures.


title: Electronic properties of nickelate superconductor R3Ni2O7 with oxygen vacancies

abstract: The discovery of superconductivity in La3Ni2O7 has attracted significant research interest in the field of nickelate superconductors. Despite extensive studies on pristine La3Ni2O7, the impact of oxygen vacancies (VO), a common type of intrinsic defect in oxides, on electronic structures and superconductivity in La3Ni2O7 remains unclear. In this article, we identify the most energetically favorable location for VO formation as the oxygen atom connecting the NiO6 bilayer, resulting in a significant reduction in the lattice constant along the c-axis. Interestingly, the electronic structure undergoes notable changes, particularly for the Ni dz2 and Ni dx2-y2 orbitals. The Ni dz2 orbitals change from partially filled in the pristine La3Ni2O7 to completely filled in the presence of VO, leading to a considerable decrease of its proportion near the Fermi level. Conversely, the proportion of Ni dx2-y2 states increases due to the orbital localization and slight upward shift. Additionally, we observe a significant increase in the hopping of intra-bilayer Ni dz2 orbitals when the VO exists, but with an opposite sign, which differs greatly from the previous understanding. The inter-orbital hopping between Ni dz2 and Ni dx2-y2 orbitals also changes its sign in the presence of VO. Our results indicate that the formation of VO may be harmful to the superconductivity in La3Ni2O7, given the general assumption for the critical role of Ni dz2 in generating superconductivity. Furthermore, we suggest that Ce3Ni2O7, which shares similar electronic structures to La3Ni2O7 but has a larger lattice volume, may be a better candidate for nickelate superconductor due to its lower VO concentration.


title: Multiscale Topology in Interactomic Network: From Transcriptome to Antiaddiction Drug Repurposing

abstract: The escalating drug addiction crisis in the United States underscores the urgent need for innovative therapeutic strategies. This study embarked on an innovative and rigorous strategy to unearth potential drug repurposing candidates for opioid and cocaine addiction treatment, bridging the gap between transcriptomic data analysis and drug discovery. We initiated our approach by conducting differential gene expression analysis on addiction-related transcriptomic data to identify key genes. We propose a novel topological differentiation to identify key genes from a protein-protein interaction (PPI) network derived from DEGs. This method utilizes persistent Laplacians to accurately single out pivotal nodes within the network, conducting this analysis in a multiscale manner to ensure high reliability. Through rigorous literature validation, pathway analysis, and data-availability scrutiny, we identified three pivotal molecular targets, mTOR, mGluR5, and NMDAR, for drug repurposing from DrugBank. We crafted machine learning models employing two natural language processing (NLP)-based embeddings and a traditional 2D fingerprint, which demonstrated robust predictive ability in gauging binding affinities of DrugBank compounds to selected targets. Furthermore, we elucidated the interactions of promising drugs with the targets and evaluated their drug-likeness. This study delineates a multi-faceted and comprehensive analytical framework, amalgamating bioinformatics, topological data analysis and machine learning, for drug repurposing in addiction treatment, setting the stage for subsequent experimental validation. The versatility of the methods we developed allows for applications across a range of diseases and transcriptomic datasets.


title: An Augmented Lagrangian Primal-Dual Semismooth Newton Method for Multi-Block Composite Optimization

abstract: In this paper, we develop a novel primal-dual semismooth Newton method for solving linearly constrained multi-block convex composite optimization problems. First, a differentiable augmented Lagrangian (AL) function is constructed by utilizing the Moreau envelopes of the nonsmooth functions. It enables us to derive an equivalent saddle point problem and establish the strong AL duality under the Slater's condition. Consequently, a semismooth system of nonlinear equations is formulated to characterize the optimality of the original problem instead of the inclusion-form KKT conditions. We then develop a semismooth Newton method, called ALPDSN, which uses purely second-order steps and a nonmonotone line search based globalization strategy. Through a connection to the inexact first-order steps when the regularization parameter is sufficiently large, the global convergence of ALPDSN is established. Under the regularity conditions, partial smoothness, the local error bound, and the strict complementarity, we show that both the primal and the dual iteration sequences possess a superlinear convergence rate and provide concrete examples where these regularity conditions are met. Numerical results on the image restoration with two regularization terms and the corrected tensor nuclear norm problem are presented to demonstrate the high efficiency and robustness of our ALPDSN.


title: Learning to Compose SuperWeights for Neural Parameter Allocation Search

abstract: Neural parameter allocation search (NPAS) automates parameter sharing by obtaining weights for a network given an arbitrary, fixed parameter budget. Prior work has two major drawbacks we aim to address. First, there is a disconnect in the sharing pattern between the search and training steps, where weights are warped for layers of different sizes during the search to measure similarity, but not during training, resulting in reduced performance. To address this, we generate layer weights by learning to compose sets of SuperWeights, which represent a group of trainable parameters. These SuperWeights are created to be large enough so they can be used to represent any layer in the network, but small enough that they are computationally efficient. The second drawback we address is the method of measuring similarity between shared parameters. Whereas prior work compared the weights themselves, we argue this does not take into account the amount of conflict between the shared weights. Instead, we use gradient information to identify layers with shared weights that wish to diverge from each other. We demonstrate that our SuperWeight Networks consistently boost performance over the state-of-the-art on the ImageNet and CIFAR datasets in the NPAS setting. We further show that our approach can generate parameters for many network architectures using the same set of weights. This enables us to support tasks like efficient ensembling and anytime prediction, outperforming fully-parameterized ensembles with 17% fewer parameters.


title: A Review of Link Prediction Applications in Network Biology

abstract: In the domain of network biology, the interactions among heterogeneous genomic and molecular entities are represented through networks. Link prediction (LP) methodologies are instrumental in inferring missing or prospective associations within these biological networks. In this review, we systematically dissect the attributes of local, centrality, and embedding-based LP approaches, applied to static and dynamic biological networks. We undertake an examination of the current applications of LP metrics for predicting links between diseases, genes, proteins, RNA, microbiomes, drugs, and neurons. We carry out comprehensive performance evaluations on established biological network datasets to show the practical applications of standard LP models. Moreover, we compare the similarity in prediction trends among the models and the specific network attributes that contribute to effective link prediction, before underscoring the role of LP in addressing the formidable challenges prevalent in biological systems, ranging from noise, bias, and data sparseness to interpretability. We conclude the review with an exploration of the essential characteristics expected from future LP models, poised to advance our comprehension of the intricate interactions governing biological systems.


title: Running cognitive evaluations on large language models: The do's and the don'ts

abstract: In this paper, I describe methodological considerations for studies that aim to evaluate the cognitive capacities of large language models (LLMs) using language-based behavioral assessments. Drawing on three case studies from the literature (a commonsense knowledge benchmark, a theory of mind evaluation, and a test of syntactic agreement), I describe common pitfalls that might arise when applying a cognitive test to an LLM. I then list 10 do's and don'ts that should help design high-quality cognitive evaluations for AI systems. I conclude by discussing four areas where the do's and don'ts are currently under active discussion -- prompt sensitivity, cultural and linguistic diversity, using LLMs as research assistants, and running evaluations on open vs. closed LLMs. Overall, the goal of the paper is to contribute to the broader discussion of best practices in the rapidly growing field of AI Psychology.


title: Black holes immersed in dark matter: energy condition and sound speed

abstract: In this work, we study the impact of the environment around a black hole in detail. We introduce non-vanishing radial pressure in a manner analogous to compact stars. We examine both isotropic and anisotropic fluid configurations with and without radial pressure respectively. Our focus extends beyond just dark matter density to the vital role of the energy condition and sound speed in the spacetime of a black hole immersed in matter. In cases of anisotropic pressure with vanishing radial pressure, all profiles violate the dominant energy condition near the BH, and the tangential sound speed exceeds light speed for all dark matter profiles. In our second approach, without assuming vanishing radial pressure, we observe similar violations and superluminal sound speeds. To rectify this, we introduce a hard cutoff for the sound speed, ensuring it remains subluminal. As a consequence, the energy condition is also satisfied. However, this results in increased density and pressure near the BH. This raises questions about the sound speed and its impact on the density structure, as well as questions about the validity of the model itself. With the matter distribution, we also compute the metric for different configurations. It reveals sensitivity to the profile structure. The metric components point towards the horizon structure.


title: OGLE-2019-BLG-1180Lb: Discovery of a Wide-orbit Jupiter-mass Planet around a Late-type Star

abstract: We report on the discovery and analysis of the planetary microlensing event OGLE-2019-BLG-1180 with a planet-to-star mass ratio $q \sim 0.003$. The event OGLE-2019-BLG-1180 has unambiguous cusp-passing and caustic-crossing anomalies, which were caused by a wide planetary caustic with $s \simeq 2$, where $s$ is the star-planet separation in units of the angular Einstein radius $\theta_{E}$. Thanks to well-covered anomalies by the Korea Micorolensing Telescope Network (KMTNet), we measure both the angular Einstein radius and the microlens parallax in spite of a relatively short event timescale of $t_{E} = 28$ days. However, because of a weak constraint on the parallax, we conduct a Bayesian analysis to estimate the physical lens parameters. We find that the lens system is a super-Jupiter-mass planet of $M_{p} = 1.75^{+0.54}_{-0.51} M_{J}$ orbiting a late-type star of $M_{h}=0.55^{+0.27}_{-0.26} M_\odot$ at a distance of $D_{L} = 6.1^{+0.9}_{-1.3}$ kpc. The projected star-planet separation is $a_{\perp} = 5.19^{+0.90}_{-1.23}$ au, which means that the planet orbits at about four times the snow line of the host star. Considering the relative lens-source proper motion of $\mu_{rel} = 6$ mas/yr, the lens will be separated from the source by 60 mas in 2029. At that time one can measure the lens flux from adaptive optics imaging of Kec or a next-generation 30 m class telescope. OGLE-2019-BLG-1180Lb represents a growing population of wide-orbit planets detected by KMTNet, so we also present a general investigation into prospects for further expanding the sample of such planets.


title: TextGenSHAP: Scalable Post-hoc Explanations in Text Generation with Long Documents

abstract: Large language models (LLMs) have attracted huge interest in practical applications given their increasingly accurate responses and coherent reasoning abilities. Given their nature as black-boxes using complex reasoning processes on their inputs, it is inevitable that the demand for scalable and faithful explanations for LLMs' generated content will continue to grow. There have been major developments in the explainability of neural network models over the past decade. Among them, post-hoc explainability methods, especially Shapley values, have proven effective for interpreting deep learning models. However, there are major challenges in scaling up Shapley values for LLMs, particularly when dealing with long input contexts containing thousands of tokens and autoregressively generated output sequences. Furthermore, it is often unclear how to effectively utilize generated explanations to improve the performance of LLMs. In this paper, we introduce TextGenSHAP, an efficient post-hoc explanation method incorporating LM-specific techniques. We demonstrate that this leads to significant increases in speed compared to conventional Shapley value computations, reducing processing times from hours to minutes for token-level explanations, and to just seconds for document-level explanations. In addition, we demonstrate how real-time Shapley values can be utilized in two important scenarios, providing better understanding of long-document question answering by localizing important words and sentences; and improving existing document retrieval systems through enhancing the accuracy of selected passages and ultimately the final responses.


title: Brain Decodes Deep Nets

abstract: We developed a tool for visualizing and analyzing large pre-trained vision models by mapping them onto the brain, thus exposing their hidden inside. Our innovation arises from a surprising usage of brain encoding: predicting brain fMRI measurements in response to images. We report two findings. First, explicit mapping between the brain and deep-network features across dimensions of space, layers, scales, and channels is crucial. This mapping method, FactorTopy, is plug-and-play for any deep-network; with it, one can paint a picture of the network onto the brain (literally!). Second, our visualization shows how different training methods matter: they lead to remarkable differences in hierarchical organization and scaling behavior, growing with more data or network capacity. It also provides insight into fine-tuning: how pre-trained models change when adapting to small datasets. We found brain-like hierarchically organized network suffer less from catastrophic forgetting after fine-tuned.


title: Mendata: A Framework to Purify Manipulated Training Data

abstract: Untrusted data used to train a model might have been manipulated to endow the learned model with hidden properties that the data contributor might later exploit. Data purification aims to remove such manipulations prior to training the model. We propose Mendata, a novel framework to purify manipulated training data. Starting from a small reference dataset in which a large majority of the inputs are clean, Mendata perturbs the training inputs so that they retain their utility but are distributed similarly (as measured by Wasserstein distance) to the reference data, thereby eliminating hidden properties from the learned model. A key challenge is how to find such perturbations, which we address by formulating a min-max optimization problem and developing a two-step method to iteratively solve it. We demonstrate the effectiveness of Mendata by applying it to defeat state-of-the-art data poisoning and data tracing techniques.


title: Dehn invariant zero tetrahedra

abstract: We survey literature on all known families and examples of Dehn invariant zero tetrahedra. We also contribute two previously unknown families of Dehn invariant zero tetrahedra. Following a suggestion of Dill and Habegger, we show that there are finitely many Dehn invariant zero tetrahedra whose dihedral angles have a five-dimensional span over $\mathbb{Q}$, a first step towards classifying all Dehn invariant zero tetrahedra.


title: Deeper into Self-Supervised Monocular Indoor Depth Estimation

abstract: Monocular depth estimation using Convolutional Neural Networks (CNNs) has shown impressive performance in outdoor driving scenes. However, self-supervised learning of indoor depth from monocular sequences is quite challenging for researchers because of the following two main reasons. One is the large areas of low-texture regions and the other is the complex ego-motion on indoor training datasets. In this work, our proposed method, named IndoorDepth, consists of two innovations. In particular, we first propose a novel photometric loss with improved structural similarity (SSIM) function to tackle the challenge from low-texture regions. Moreover, in order to further mitigate the issue of inaccurate ego-motion prediction, multiple photometric losses at different stages are used to train a deeper pose network with two residual pose blocks. Subsequent ablation study can validate the effectiveness of each new idea. Experiments on the NYUv2 benchmark demonstrate that our IndoorDepth outperforms the previous state-of-the-art methods by a large margin. In addition, we also validate the generalization ability of our method on ScanNet dataset. Code is availabe at https://github.com/fcntes/IndoorDepth.


title: Stable Messenger: Steganography for Message-Concealed Image Generation

abstract: In the ever-expanding digital landscape, safeguarding sensitive information remains paramount. This paper delves deep into digital protection, specifically focusing on steganography. While prior research predominantly fixated on individual bit decoding, we address this limitation by introducing ``message accuracy'', a novel metric evaluating the entirety of decoded messages for a more holistic evaluation. In addition, we propose an adaptive universal loss tailored to enhance message accuracy, named Log-Sum-Exponential (LSE) loss, thereby significantly improving the message accuracy of recent approaches. Furthermore, we also introduce a new latent-aware encoding technique in our framework named \Approach, harnessing pretrained Stable Diffusion for advanced steganographic image generation, giving rise to a better trade-off between image quality and message recovery. Throughout experimental results, we have demonstrated the superior performance of the new LSE loss and latent-aware encoding technique. This comprehensive approach marks a significant step in evolving evaluation metrics, refining loss functions, and innovating image concealment techniques, aiming for more robust and dependable information protection.


title: A Literature Review on the Smart Wheelchair Systems

abstract: This study offers an in-depth analysis of smart wheelchair (SW) systems, charting their progression from early developments to future innovations. It delves into various Brain-Computer Interface (BCI) systems, including mu rhythm, event-related potential, and steady-state visual evoked potential. The paper addresses challenges in signal categorization, proposing the sparse Bayesian extreme learning machine as an innovative solution. Additionally, it explores the integration of emotional states in BCI systems, the application of alternative control methods such as EMG-based systems, and the deployment of intelligent adaptive interfaces utilizing recurrent quantum neural networks. The study also covers advancements in autonomous navigation, assistance, and mapping, emphasizing their importance in SW systems. The human aspect of SW interaction receives considerable attention, specifically in terms of privacy, physiological factors, and the refinement of control mechanisms. The paper acknowledges the commercial challenges faced, like the limitations of indoor usage and the necessity for user training. For future applications, the research explores the potential of autonomous systems adept at adapting to changing environments and user needs. This exploration includes reinforcement learning and various control methods, such as eye and voice control, to improve adaptability and interaction. The potential integration with smart home technologies, including advanced features such as robotic arms, is also considered, aiming to further enhance user accessibility and independence. Ultimately, this study seeks to provide a thorough overview of SW systems, presenting extensive research to detail their historical evolution, current state, and future prospects.


title: Continuous Convolutional Neural Networks for Disruption Prediction in Nuclear Fusion Plasmas

abstract: Grid decarbonization for climate change requires dispatchable carbon-free energy like nuclear fusion. The tokamak concept offers a promising path for fusion, but one of the foremost challenges in implementation is the occurrence of energetic plasma disruptions. In this study, we delve into Machine Learning approaches to predict plasma state outcomes. Our contributions are twofold: (1) We present a novel application of Continuous Convolutional Neural Networks for disruption prediction and (2) We examine the advantages and disadvantages of continuous models over discrete models for disruption prediction by comparing our model with the previous, discrete state of the art, and show that continuous models offer significantly better performance (Area Under the Receiver Operating Characteristic Curve = 0.974 v.s. 0.799) with fewer parameters


title: Complete Nevanlinna-Pick kernels, the Schwarz lemma and the Schur algorithm

abstract: We investigate the Schwarz lemma and the Schur algorithm for elements in the unit ball of the multiplier algebra of a reproducing kernel Hilbert space on the open unit ball whose kernel satisfies the complete Nevanlinna-Pick property. This paper also explores the Poincar\'e contractivity for elements in the unit ball of the multiplier algebra of a reproducing kernel Hilbert space whose kernel satisfies the property mentioned above.