title: A Case Study of Image Enhancement Algorithms' Effectiveness of Improving Neural Networks' Performance on Adverse Images

abstract: Neural Networks (NNs) have become indispensable for applications of Computer Vision (CV) and their use has been ever-growing. NNs are commonly trained for long periods of time on datasets like ImageNet and COCO that have been carefully created to represent common "real-world" environments. When deployed in the field, such as applications of autonomous vehicles, NNs can encounter adverse scenarios that degrade performance. Using image enhancements algorithms to enhance images before being inferenced on a NN model poses an intriguing alternative to retraining, however, published literature on the effectiveness of this solution is scarce. To fill this knowledge gap, we provide a case study on two popular image enhancement algorithms, Histogram Equalization (HE) and Retinex (RX). We simulate four types of adverse scenarios an autonomous vehicle could encounter, dark, over exposed, foggy, and dark & rainy weather conditions. We evaluate the effectiveness of HE and RX using several well established models:, Resnet, GoogleLeNet, YOLO, and a Vision Transformer.


title: Fast Sampling generative model for Ultrasound image reconstruction

abstract: Image reconstruction from radio-frequency data is pivotal in ultrafast plane wave ultrasound imaging. Unlike the conventional delay-and-sum (DAS) technique, which relies on somewhat imprecise assumptions, deep learning-based methods perform image reconstruction by training on paired data, leading to a notable enhancement in image quality. Nevertheless, these strategies often exhibit limited generalization capabilities. Recently, denoising diffusion models have become the preferred paradigm for image reconstruction tasks. However, their reliance on an iterative sampling procedure results in prolonged generation time. In this paper, we propose a novel sampling framework that concurrently enforces data consistency of ultrasound signals and data-driven priors. By leveraging the advanced diffusion model, the generation of high-quality images is substantially expedited. Experimental evaluations on an in-vivo dataset indicate that our approach with a single plane wave surpasses DAS with spatial coherent compounding of 75 plane waves.


title: MONET: Modality-Embracing Graph Convolutional Network and Target-Aware Attention for Multimedia Recommendation

abstract: In this paper, we focus on multimedia recommender systems using graph convolutional networks (GCNs) where the multimodal features as well as user-item interactions are employed together. Our study aims to exploit multimodal features more effectively in order to accurately capture users' preferences for items. To this end, we point out following two limitations of existing GCN-based multimedia recommender systems: (L1) although multimodal features of interacted items by a user can reveal her preferences on items, existing methods utilize GCN designed to focus only on capturing collaborative signals, resulting in insufficient reflection of the multimodal features in the final user/item embeddings; (L2) although a user decides whether to prefer the target item by considering its multimodal features, existing methods represent her as only a single embedding regardless of the target item's multimodal features and then utilize her embedding to predict her preference for the target item. To address the above issues, we propose a novel multimedia recommender system, named MONET, composed of following two core ideas: modality-embracing GCN (MeGCN) and target-aware attention. Through extensive experiments using four real-world datasets, we demonstrate i) the significant superiority of MONET over seven state-of-the-art competitors (up to 30.32% higher accuracy in terms of recall@20, compared to the best competitor) and ii) the effectiveness of the two core ideas in MONET. All MONET codes are available at https://github.com/Kimyungi/MONET.


title: General monogamy and polygamy relations of arbitrary quantum correlations for multipartite systems

abstract: Monogamy and polygamy of quantum correlations are the fundamental properties of quantum systems. We study the monogamy and polygamy relations satisfied by any quantum correlations in multipartite quantum systems. General monogamy relations are presented for the $\alpha$th $(0\leq\alpha \leq\gamma$, $\gamma\geq2)$ power of quantum correlation, and general polygamy relations are given for the $\beta$th $(\beta\geq \delta$, $0\leq\delta\leq1)$ power of quantum correlation. We show that these newly derived monogamy and polygamy inequalities are tighter than the existing ones. By applying these results to specific quantum correlations such as concurrence and the square of convex-roof extended negativity of assistance (SCRENoA), the corresponding new classes of monogamy and polygamy relations are obtained, which include the existing ones as special cases. Detailed examples are given to illustrate the advantages of our results.


title: CGS-Mask: Making Time Series Predictions Intuitive for All

abstract: Artificial intelligence (AI) has immense potential in time series prediction, but most explainable tools have limited capabilities in providing a systematic understanding of important features over time. These tools typically rely on evaluating a single time point, overlook the time ordering of inputs, and neglect the time-sensitive nature of time series applications. These factors make it difficult for users, particularly those without domain knowledge, to comprehend AI model decisions and obtain meaningful explanations. We propose CGS-Mask, a post-hoc and model-agnostic cellular genetic strip mask-based saliency approach to address these challenges. CGS-Mask uses consecutive time steps as a cohesive entity to evaluate the impact of features on the final prediction, providing binary and sustained feature importance scores over time. Our algorithm optimizes the mask population iteratively to obtain the optimal mask in a reasonable time. We evaluated CGS-Mask on synthetic and real-world datasets, and it outperformed state-of-the-art methods in elucidating the importance of features over time. According to our pilot user study via a questionnaire survey, CGS-Mask is the most effective approach in presenting easily understandable time series prediction results, enabling users to comprehend the decision-making process of AI models with ease.


title: Single PW takes a shortcut to compound PW in US imaging

abstract: Reconstruction of ultrasound (US) images from radio-frequency data can be conceptualized as a linear inverse problem. Traditional deep learning approaches, which aim to improve the quality of US images by directly learning priors, often encounter challenges in generalization. Recently, diffusion-based generative models have received significant attention within the research community due to their robust performance in image reconstruction tasks. However, a limitation of these models is their inherent low speed in generating image samples from pure Gaussian noise progressively. In this study, we exploit the inherent similarity between the US images reconstructed from a single plane wave (PW) and PW compounding PWC). We hypothesize that a single PW can take a shortcut to reach the diffusion trajectory of PWC, removing the need to begin with Gaussian noise. By employing an advanced diffusion model, we demonstrate its effectiveness in US image reconstruction, achieving a substantial reduction in sampling steps. In-vivo experimental results indicate that our approach can reduce sampling steps by 60%, while preserving comparable performance metrics with the conventional diffusion model.


title: Osmotic Pressure and Swelling Behavior of Ionic Microcapsules

abstract: Ionic microcapsules are hollow shells of hydrogel, typically 10-1000 nm in radius, composed of cross-linked polymer networks that become charged and swollen in a good solvent. The ability of microcapsules to swell/deswell in response to changes in external stimuli (e.g., temperature, pH, ionic strength) suits them to applications, such as drug delivery, biosensing, and catalysis. Equilibrium swelling behavior of ionic microcapsules is determined by a balance of electrostatic and elastic forces. The electrostatic component of the osmotic pressure of a microcapsule -- the difference in pressure between the inside and outside of the particle -- plays a vital role in determining swelling behavior. Within the spherical cell model, we derive exact expressions for the radial pressure profile and for the electrostatic and gel components of the osmotic pressure of a microcapsule, which we compute via Poisson-Boltzmann theory and molecular dynamics simulation. For the gel component, we use the Flory-Rehner theory of polymer networks. By combining the electrostatic and gel components of the osmotic pressure, we compute the equilibrium size of ionic microcapsules as a function of particle concentration, shell thickness, and valence. We predict concentration-driven deswelling at relatively low concentrations at which steric interactions between particles are weak, and demonstrate that this response can be attributed to crowding-induced redistribution of counterions. Our approach may help to guide the design and applications of smart, stimuli-responsive colloidal particles.


title: Intrinsic toroidal rotation driven by turbulent and neoclassical processes in tokamak plasmas from global gyrokinetic simulations

abstract: Gyrokinetic tokamak plasmas can exhibit intrinsic toroidal rotation driven by the residual stress. While most studies have attributed the residual stress to the parallel-momentum flux from the turbulent $\boldsymbol{E}\times\boldsymbol{B}$ motion, the parallel-momentum flux from the drift-orbit motion (denoted $\Pi_\parallel^D$) and the $\boldsymbol{E}\times\boldsymbol{B}$-momentum flux from the $\boldsymbol{E}\times\boldsymbol{B}$ motion (denoted $\Pi_{E\times B}$) are often neglected. Here, we use the global total-$f$ gyrokinetic code XGC to study the residual stress in the core and the edge of a DIII-D H-mode plasma. Numerical results show that both $\Pi_\parallel^D$ and $\Pi_{E\times B}$ make up a significant portion of the residual stress. In particular, $\Pi_\parallel^D$ in the core is higher than the collisional neoclassical level in the presence of turbulence, while in the edge it represents an outflux of counter-current momentum even without turbulence. Using a recently developed ``orbit-flux'' formulation, we show that the higher-than-neoclassical-level $\Pi_\parallel^D$ in the core is driven by turbulence, while the outflux of counter-current momentum from the edge is mainly due to collisional ion orbit loss. These results suggest that $\Pi_\parallel^D$ and $\Pi_{E\times B}$ can be important for the study of intrinsic toroidal rotation.


title: A wearable Gait Assessment Method for Lumbar Disc Herniation Based on Adaptive Kalman Filtering

abstract: Lumbar disc herniation (LDH) is a prevalent orthopedic condition in clinical practice. Inertial measurement unit sensors (IMUs) are an effective tool for monitoring and assessing gait impairment in patients with lumbar disc herniation (LDH). However, the current gait assessment of LDH focuses solely on single-source acceleration signal data, without considering the diversity of sensor data. It also overlooks the individual differences in motor function deterioration between the healthy and affected lower limbs in patients with LDH. To address this issue, we developed an LDH gait feature model that relies on multi-source adaptive Kalman data fusion of acceleration and angular velocity. We utilized an adaptive Kalman data fusion algorithm for acceleration and angular velocity to estimate the attitude angle and segment the gait phase. Two Inertial Measurement Units (IMUs) were used to analyze the gait characteristics of patients with lumbar disc issues and healthy individuals. This analysis included 12 gait characteristics, such as gait spatiotemporal parameters, kinematic parameters, and expansibility index numbers. Statistical methods were employed to analyze the characteristic model and confirm the biological differences between the healthy affected side of LDH and healthy subjects. Finally, a classifier based on feature engineering was utilized to classify the gait patterns of the affected side of patients with lumbar disc disease and healthy subjects. This approach achieved a classification accuracy of 95.50%, enhancing the recognition of LDH and healthy gait patterns. It also provided effective gait feature sets and methods for assessing LDH clinically.


title: Further improving quantum algorithms for nonlinear differential equations via higher-order methods and rescaling

abstract: The solution of large systems of nonlinear differential equations is needed for many applications in science and engineering. In this study, we present three main improvements to existing quantum algorithms based on the Carleman linearisation technique. First, by using a high-precision technique for the solution of the linearised differential equations, we achieve logarithmic dependence of the complexity on the error and near-linear dependence on time. Second, we demonstrate that a rescaling technique can considerably reduce the cost, which would otherwise be exponential in the Carleman order for a system of ODEs, preventing a quantum speedup for PDEs. Third, we provide improved, tighter bounds on the error of Carleman linearisation. We apply our results to a class of discretised reaction-diffusion equations using higher-order finite differences for spatial resolution. We show that providing a stability criterion independent of the discretisation can conflict with the use of the rescaling due to the difference between the max-norm and 2-norm. An efficient solution may still be provided if the number of discretisation points is limited, as is possible when using higher-order discretisations.


title: Osmotic Swelling Behavior of Surface-Charged Ionic Microgels

abstract: In recent years, ionic microgels have garnered much attention due to their unique properties, especially their stimulus-sensitive swelling behavior. The tunable response of these soft, permeable, compressible, charged colloidal particles is increasingly attractive for applications in medicine and biotechnologies, such as controlled drug delivery, tissue engineering, and biosensing. The ability to model and predict variation of the osmotic pressure of a single microgel with respect to changes in particle properties and environmental conditions proves vital to such applications. In this work, we apply both nonlinear Poisson-Boltzmann theory and molecular dynamics simulation to ionic microgels (macroions) in the cell model to compute density profiles of microions (counterions, coions), single-microgel osmotic pressure, and equilibrium swelling ratios of spherical microgels whose fixed charge is confined to the macroion surface. The basis of our approach is an exact theorem that relates the electrostatic component of the osmotic pressure to the microion density profiles. Close agreement between theory and simulation serves as a consistency check to validate our approach. We predict that surface-charged microgels progressively deswell with increasing microgel concentration, starting well below close packing, and with increasing salt concentration, in qualitative agreement with experiments. Comparison with previous results for microgels with fixed charge uniformly distributed over their volume demonstrates that surface-charged microgels deswell more rapidly than volume-charged microgels. We conclude that swelling behavior of ionic microgels in solution is sensitive to the distribution of fixed charge within the polymer-network gel and strongly depends on bulk concentrations of both microgels and salt ions.


title: SlowTrack: Increasing the Latency of Camera-based Perception in Autonomous Driving Using Adversarial Examples

abstract: In Autonomous Driving (AD), real-time perception is a critical component responsible for detecting surrounding objects to ensure safe driving. While researchers have extensively explored the integrity of AD perception due to its safety and security implications, the aspect of availability (real-time performance) or latency has received limited attention. Existing works on latency-based attack have focused mainly on object detection, i.e., a component in camera-based AD perception, overlooking the entire camera-based AD perception, which hinders them to achieve effective system-level effects, such as vehicle crashes. In this paper, we propose SlowTrack, a novel framework for generating adversarial attacks to increase the execution time of camera-based AD perception. We propose a novel two-stage attack strategy along with the three new loss function designs. Our evaluation is conducted on four popular camera-based AD perception pipelines, and the results demonstrate that SlowTrack significantly outperforms existing latency-based attacks while maintaining comparable imperceptibility levels. Furthermore, we perform the evaluation on Baidu Apollo, an industry-grade full-stack AD system, and LGSVL, a production-grade AD simulator, with two scenarios to compare the system-level effects of SlowTrack and existing attacks. Our evaluation results show that the system-level effects can be significantly improved, i.e., the vehicle crash rate of SlowTrack is around 95% on average while existing works only have around 30%.


title: Multi-Objective Complementary Control

abstract: This paper proposes a novel multi-objective control framework for linear time-invariant systems in which performance and robustness can be achieved in a complementary way instead of trade-off. In particular, a state-space solution is first established for a new stabilizing control structure consisting of two independently designed controllers coordinated with a Youla-type operator ${\bm Q}$. It is then shown by performance analysis that these two independently designed controllers operate in a naturally complementary way for a tracking control system, due to coordination function of ${\bm Q}$ driven by the residual signal of a Luenberger observer. Moreover, it is pointed out that ${\bm Q}$ could be further optimized with an additional gain factor to achieve improved performance, through a data-driven methodology for a measured cost function.


title: Annealed transition density of simple random walk on a high-dimensional loop-erased random walk

abstract: We derive sub-Gaussian bounds for the annealed transition density of the simple random walk on a high-dimensional loop-erased random walk. The walk dimension that appears in these is the exponent governing the space-time scaling of the process with respect to the extrinsic Euclidean distance, which contrasts with the exponent given by the intrinsic graph distance that appears in the corresponding quenched bounds. We prove our main result using novel pointwise Gaussian estimates on the distribution of the high-dimensional loop-erased random walk.


title: DriveTrack: A Benchmark for Long-Range Point Tracking in Real-World Videos

abstract: This paper presents DriveTrack, a new benchmark and data generation framework for long-range keypoint tracking in real-world videos. DriveTrack is motivated by the observation that the accuracy of state-of-the-art trackers depends strongly on visual attributes around the selected keypoints, such as texture and lighting. The problem is that these artifacts are especially pronounced in real-world videos, but these trackers are unable to train on such scenes due to a dearth of annotations. DriveTrack bridges this gap by building a framework to automatically annotate point tracks on autonomous driving datasets. We release a dataset consisting of 1 billion point tracks across 24 hours of video, which is seven orders of magnitude greater than prior real-world benchmarks and on par with the scale of synthetic benchmarks. DriveTrack unlocks new use cases for point tracking in real-world videos. First, we show that fine-tuning keypoint trackers on DriveTrack improves accuracy on real-world scenes by up to 7%. Second, we analyze the sensitivity of trackers to visual artifacts in real scenes and motivate the idea of running assistive keypoint selectors alongside trackers.


title: Ratio bound (Lov\'asz number) versus inertia bound

abstract: Matthew Kwan and Yuval Wigderson showed that for an infinite family of graphs, the Lov\'asz number gives an upper bound of $O(n^{3/4})$ for the size of an independent set (where $n$ is the number of vertices), while the weighted inertia bound cannot do better than $\Omega(n)$. Here we point out that there is an infinite family of graphs for which the Lov\'asz number is $\Omega(n^{3/4})$, while the unweighted inertia bound is $O(n^{1/2})$.


title: Hierarchical Graph Pattern Understanding for Zero-Shot VOS

abstract: The optical flow guidance strategy is ideal for obtaining motion information of objects in the video. It is widely utilized in video segmentation tasks. However, existing optical flow-based methods have a significant dependency on optical flow, which results in poor performance when the optical flow estimation fails for a particular scene. The temporal consistency provided by the optical flow could be effectively supplemented by modeling in a structural form. This paper proposes a new hierarchical graph neural network (GNN) architecture, dubbed hierarchical graph pattern understanding (HGPU), for zero-shot video object segmentation (ZS-VOS). Inspired by the strong ability of GNNs in capturing structural relations, HGPU innovatively leverages motion cues (\ie, optical flow) to enhance the high-order representations from the neighbors of target frames. Specifically, a hierarchical graph pattern encoder with message aggregation is introduced to acquire different levels of motion and appearance features in a sequential manner. Furthermore, a decoder is designed for hierarchically parsing and understanding the transformed multi-modal contexts to achieve more accurate and robust results. HGPU achieves state-of-the-art performance on four publicly available benchmarks (DAVIS-16, YouTube-Objects, Long-Videos and DAVIS-17). Code and pre-trained model can be found at \url{https://github.com/NUST-Machine-Intelligence-Laboratory/HGPU}.


title: A Lower Bound of the Hofer-Zehnder Capacity via Delzant Polytopes

abstract: Given a symplectic toric manifold, the moment maps of sub-circle actions can be modified to be admissible functions in the sense of Hofer-Zehnder. By exploiting the relationship between the period of Hamiltonian sub-circle actions of a symplectic toric manifold and its Delzant polytope, we develop an invariant of Delzant polytopes which gives a lower bound of the Hofer-Zehnder capacity.


title: TIFace: Improving Facial Reconstruction through Tensorial Radiance Fields and Implicit Surfaces

abstract: This report describes the solution that secured the first place in the "View Synthesis Challenge for Human Heads (VSCHH)" at the ICCV 2023 workshop. Given the sparse view images of human heads, the objective of this challenge is to synthesize images from novel viewpoints. Due to the complexity of textures on the face and the impact of lighting, the baseline method TensoRF yields results with significant artifacts, seriously affecting facial reconstruction. To address this issue, we propose TI-Face, which improves facial reconstruction through tensorial radiance fields (T-Face) and implicit surfaces (I-Face), respectively. Specifically, we employ an SAM-based approach to obtain the foreground mask, thereby filtering out intense lighting in the background. Additionally, we design mask-based constraints and sparsity constraints to eliminate rendering artifacts effectively. The experimental results demonstrate the effectiveness of the proposed improvements and superior performance of our method on face reconstruction. The code will be available at https://github.com/RuijieZhu94/TI-Face.


title: QCD at finite temperature and density: Criticality

abstract: We overview recent theoretical developments in the search for QCD critical point at finite temperature and density, including from lattice QCD, effective QCD theories, and proton number cumulants in heavy-ion collisions. We summarize the available constraints and predictions for the critical point location and discuss future challenges and opportunities.


title: Can Physician Judgment Enhance Model Trustworthiness? A Case Study on Predicting Pathological Lymph Nodes in Rectal Cancer

abstract: Explainability is key to enhancing artificial intelligence's trustworthiness in medicine. However, several issues remain concerning the actual benefit of explainable models for clinical decision-making. Firstly, there is a lack of consensus on an evaluation framework for quantitatively assessing the practical benefits that effective explainability should provide to practitioners. Secondly, physician-centered evaluations of explainability are limited. Thirdly, the utility of built-in attention mechanisms in transformer-based models as an explainability technique is unclear. We hypothesize that superior attention maps should align with the information that physicians focus on, potentially reducing prediction uncertainty and increasing model reliability. We employed a multimodal transformer to predict lymph node metastasis in rectal cancer using clinical data and magnetic resonance imaging, exploring how well attention maps, visualized through a state-of-the-art technique, can achieve agreement with physician understanding. We estimated the model's uncertainty using meta-level information like prediction probability variance and quantified agreement. Our assessment of whether this agreement reduces uncertainty found no significant effect. In conclusion, this case study did not confirm the anticipated benefit of attention maps in enhancing model reliability. Superficial explanations could do more harm than good by misleading physicians into relying on uncertain predictions, suggesting that the current state of attention mechanisms in explainability should not be overestimated. Identifying explainability mechanisms truly beneficial for clinical decision-making remains essential.


title: Uniaxial zero thermal expansion in low-cost Mn2OBO3 from 3.5 to 1250 K

abstract: Unique zero thermal expansion (ZTE) materials are valuable for use in precision instruments, including electronics, aerospace parts, and engines. However, most ZTE materials have a temperature range less than 1000 K under which they do not expand. In this study, we present a uniaxial ZTE in the low-cost Mn2OBO3 with a thermal expansion coefficient of $\alpha$= -1.7$\times$10^(-7) K-1 along the [h00] direction from 3.5 to 1250 K. The monoclinic structure of Mn2OBO3 remains stable over the entire temperature range in ambient conditions. Considerable thermal contraction on the BO3 trigonal planar and thermal expansion on the MnO6 octahedra combine to produce uniaxial ZTE. No charge order-disorder transition, which could cause thermal contraction, was observed up to 1250 K.


title: Steered quantum coherence and quantum Fisher information in spin-chain system

abstract: In this paper, we investigate steered quantum coherence, i.e., the $l_1$ norm of steered coherence and the relative entropy of steered coherence, and the quantum Fisher information in the Gibbs state of two-qubit $XXZ$ systems. Their variations with respect to the temperature, external magnetic field, and interaction intensities are analyzed both analytically and numerically in detail. The similar behaviors among these three quantum measures in the $XXZ$ model are presented.


title: Grounding for Artificial Intelligence

abstract: A core function of intelligence is grounding, which is the process of connecting the natural language and abstract knowledge to the internal representation of the real world in an intelligent being, e.g., a human. Human cognition is grounded in our sensorimotor experiences in the external world and subjective feelings in our internal world. We use languages to communicate with each other and the languages are grounded on our shared sensorimotor experiences and feelings. Without this shard grounding, it is impossible for us to understand each other because all natural languages are highly abstract and are only able to describe a tiny portion of what has happened or is happening in the real world. Although grounding at high or abstract levels has been studied in different fields and applications, to our knowledge, limited systematic work at fine-grained levels has been done. With the rapid progress of large language models (LLMs), it is imperative that we have a sound understanding of grounding in order to move to the next level of intelligence. It is also believed that grounding is necessary for Artificial General Intelligence (AGI). This paper makes an attempt to systematically study this problem.


title: Adversarial Robustness on Image Classification with $k$-means

abstract: In this paper we explore the challenges and strategies for enhancing the robustness of $k$-means clustering algorithms against adversarial manipulations. We evaluate the vulnerability of clustering algorithms to adversarial attacks, emphasising the associated security risks. Our study investigates the impact of incremental attack strength on training, introduces the concept of transferability between supervised and unsupervised models, and highlights the sensitivity of unsupervised models to sample distributions. We additionally introduce and evaluate an adversarial training method that improves testing performance in adversarial scenarios, and we highlight the importance of various parameters in the proposed training method, such as continuous learning, centroid initialisation, and adversarial step-count.


title: WeatherProof: A Paired-Dataset Approach to Semantic Segmentation in Adverse Weather

abstract: The introduction of large, foundational models to computer vision has led to drastically improved performance on the task of semantic segmentation. However, these existing methods exhibit a large performance drop when testing on images degraded by weather conditions such as rain, fog, or snow. We introduce a general paired-training method that can be applied to all current foundational model architectures that leads to improved performance on images in adverse weather conditions. To this end, we create the WeatherProof Dataset, the first semantic segmentation dataset with accurate clear and adverse weather image pairs, which not only enables our new training paradigm, but also improves the evaluation of the performance gap between clear and degraded segmentation. We find that training on these paired clear and adverse weather frames which share an underlying scene results in improved performance on adverse weather data. With this knowledge, we propose a training pipeline which accentuates the advantages of paired-data training using consistency losses and language guidance, which leads to performance improvements by up to 18.4% as compared to standard training procedures.


title: VDOO: A Short, Fast, Post-Quantum Multivariate Digital Signature Scheme

abstract: Hard lattice problems are predominant in constructing post-quantum cryptosystems. However, we need to continue developing post-quantum cryptosystems based on other quantum hard problems to prevent a complete collapse of post-quantum cryptography due to a sudden breakthrough in solving hard lattice problems. Solving large multivariate quadratic systems is one such quantum hard problem. Unbalanced Oil-Vinegar is a signature scheme based on the hardness of solving multivariate equations. In this work, we present a post-quantum digital signature algorithm VDOO (Vinegar-Diagonal-Oil-Oil) based on solving multivariate equations. We introduce a new layer called the diagonal layer over the oil-vinegar-based signature scheme Rainbow. This layer helps to improve the security of our scheme without increasing the parameters considerably. Due to this modification, the complexity of the main computational bottleneck of multivariate quadratic systems i.e. the Gaussian elimination reduces significantly. Thus making our scheme one of the fastest multivariate quadratic signature schemes. Further, we show that our carefully chosen parameters can resist all existing state-of-the-art attacks. The signature sizes of our scheme for the National Institute of Standards and Technology's security level of I, III, and V are 96, 226, and 316 bytes, respectively. This is the smallest signature size among all known post-quantum signature schemes of similar security.


title: Riveter: Measuring Power and Social Dynamics Between Entities

abstract: Riveter provides a complete easy-to-use pipeline for analyzing verb connotations associated with entities in text corpora. We prepopulate the package with connotation frames of sentiment, power, and agency, which have demonstrated usefulness for capturing social phenomena, such as gender bias, in a broad range of corpora. For decades, lexical frameworks have been foundational tools in computational social science, digital humanities, and natural language processing, facilitating multifaceted analysis of text corpora. But working with verb-centric lexica specifically requires natural language processing skills, reducing their accessibility to other researchers. By organizing the language processing pipeline, providing complete lexicon scores and visualizations for all entities in a corpus, and providing functionality for users to target specific research questions, Riveter greatly improves the accessibility of verb lexica and can facilitate a broad range of future research.


title: Exploration of new chemical materials using black-box optimization with the D-wave quantum annealer

abstract: In materials informatics, searching for chemical materials with desired properties is challenging due to the vastness of the chemical space. Moreover, the high cost of evaluating properties necessitates a search with a few clues. In practice, there is also a demand for proposing compositions that are easily synthesizable. In the real world, such as in the exploration of chemical materials, it is common to encounter problems targeting black-box objective functions where formalizing the objective function in explicit form is challenging, and the evaluation cost is high. In recent research, a Bayesian optimization method has been proposed to formulate the quadratic unconstrained binary optimization (QUBO) problem as a surrogate model for black-box objective functions with discrete variables. Regarding this method, studies have been conducted using the D-Wave quantum annealer to optimize the acquisition function, which is based on the surrogate model and determines the next exploration point for the black-box objective function. In this paper, we address optimizing a black-box objective function containing discrete variables in the context of actual chemical material exploration. In this optimization problem, we demonstrate results obtaining parameters of the acquisition function by sampling from a probability distribution with variance can explore the solution space more extensively than in the case of no variance. As a result, we found combinations of substituents in compositions with the desired properties, which could only be discovered when we set an appropriate variance.


title: AEGIS-Net: Attention-guided Multi-Level Feature Aggregation for Indoor Place Recognition

abstract: We present AEGIS-Net, a novel indoor place recognition model that takes in RGB point clouds and generates global place descriptors by aggregating lower-level color, geometry features and higher-level implicit semantic features. However, rather than simple feature concatenation, self-attention modules are employed to select the most important local features that best describe an indoor place. Our AEGIS-Net is made of a semantic encoder, a semantic decoder and an attention-guided feature embedding. The model is trained in a 2-stage process with the first stage focusing on an auxiliary semantic segmentation task and the second one on the place recognition task. We evaluate our AEGIS-Net on the ScanNetPR dataset and compare its performance with a pre-deep-learning feature-based method and five state-of-the-art deep-learning-based methods. Our AEGIS-Net achieves exceptional performance and outperforms all six methods.


abstract: Learning to collaborate has witnessed significant progress in multi-agent reinforcement learning (MARL). However, promoting coordination among agents and enhancing exploration capabilities remain challenges. In multi-agent environments, interactions between agents are limited in specific situations. Effective collaboration between agents thus requires a nuanced understanding of when and how agents' actions influence others. To this end, in this paper, we propose a novel MARL algorithm named Situation-Dependent Causal Influence-Based Cooperative Multi-agent Reinforcement Learning (SCIC), which incorporates a novel Intrinsic reward mechanism based on a new cooperation criterion measured by situation-dependent causal influence among agents. Our approach aims to detect inter-agent causal influences in specific situations based on the criterion using causal intervention and conditional mutual information. This effectively assists agents in exploring states that can positively impact other agents, thus promoting cooperation between agents. The resulting update links coordinated exploration and intrinsic reward distribution, which enhance overall collaboration and performance. Experimental results on various MARL benchmarks demonstrate the superiority of our method compared to state-of-the-art approaches.


title: A Novel Hybrid Ordinal Learning Model with Health Care Application

abstract: Ordinal learning (OL) is a type of machine learning models with broad utility in health care applications such as diagnosis of different grades of a disease (e.g., mild, modest, severe) and prediction of the speed of disease progression (e.g., very fast, fast, moderate, slow). This paper aims to tackle a situation when precisely labeled samples are limited in the training set due to cost or availability constraints, whereas there could be an abundance of samples with imprecise labels. We focus on imprecise labels that are intervals, i.e., one can know that a sample belongs to an interval of labels but cannot know which unique label it has. This situation is quite common in health care datasets due to limitations of the diagnostic instrument, sparse clinical visits, or/and patient dropout. Limited research has been done to develop OL models with imprecise/interval labels. We propose a new Hybrid Ordinal Learner (HOL) to integrate samples with both precise and interval labels to train a robust OL model. We also develop a tractable and efficient optimization algorithm to solve the HOL formulation. We compare HOL with several recently developed OL methods on four benchmarking datasets, which demonstrate the superior performance of HOL. Finally, we apply HOL to a real-world dataset for predicting the speed of progressing to Alzheimer's Disease (AD) for individuals with Mild Cognitive Impairment (MCI) based on a combination of multi-modality neuroimaging and demographic/clinical datasets. HOL achieves high accuracy in the prediction and outperforms existing methods. The capability of accurately predicting the speed of progression to AD for each individual with MCI has the potential for helping facilitate more individually-optimized interventional strategies.


title: Picking the Underused Heads: A Network Pruning Perspective of Attention Head Selection for Fusing Dialogue Coreference Information

abstract: The Transformer-based models with the multi-head self-attention mechanism are widely used in natural language processing, and provide state-of-the-art results. While the pre-trained language backbones are shown to implicitly capture certain linguistic knowledge, explicitly incorporating structure-aware features can bring about further improvement on the downstream tasks. However, such enhancement often requires additional neural components and increases training parameter size. In this work, we investigate the attention head selection and manipulation strategy for feature injection from a network pruning perspective, and conduct a case study on dialogue summarization. We first rank attention heads in a Transformer-based summarizer with layer-wise importance. We then select the underused heads through extensive analysis, and inject structure-aware features by manipulating the selected heads. Experimental results show that the importance-based head selection is effective for feature injection, and dialogue summarization can be improved by incorporating coreference information via head manipulation.


title: Marathon: A Race Through the Realm of Long Context with Large Language Models

abstract: With the advancement of large language models (LLMs) and the expansion of their context windows, existing long-context benchmarks fall short in effectively evaluating the models' comprehension and reasoning abilities in extended texts. Moreover, conventional benchmarks relying on F1 metrics often inaccurately score responses: they may undervalue correct answers that differ from the reference responses and overvalue incorrect ones that resemble the reference texts. In response to these limitations, we introduce Marathon, a novel evaluation benchmark that adopts a multiple-choice question format. It is specifically designed to overcome the constraints of previous benchmarks and provide a rapid, precise, and unbiased appraisal of the long-context comprehension skills of large language models. We conducted comprehensive evaluations on the Marathon benchmark with a range of state-of-the-art LLMs and assessed the effectiveness of various optimization strategies tailored for long-context generation. We anticipate that the Marathon benchmark and its associated leaderboard will enable a more precise and equitable evaluation of LLMs' capabilities in understanding and reasoning over extended contexts. Marathon is available at https://github.com/Hambaobao/Marathon.


title: Effective interactions, structure, and pressure in charge-stabilized colloidal suspensions: Critical assessment of charge renormalization methods

abstract: Charge-stabilized colloidal suspensions display a rich variety of microstructural and thermodynamic properties, which are determined by electro-steric interactions between all ionic species. The large size asymmetry between molecular-scale microions and colloidal macroions allows the microion degrees of freedom to be integrated out, leading to an effective one-component model of microion-dressed colloidal quasi-particles. For highly-charged colloids with strong macroion-microion correlations, nonlinear effects can be incorporated into effective interactions by means of charge renormalization methods. Here, we compare and partially extend several practical mean-field methods of calculating renormalized colloidal interaction parameters, including effective charges and screening constants, as functions of concentration and ionic strength. Within the one-component description, we compute structural and thermodynamic properties from the effective interactions and assess the accuracy of the different methods by comparing predictions with elaborate primitive-model simulations [P. Linse, J. Chem. Phys. 113, 4359 (2000)]. We also compare various prescriptions for the osmotic pressure of suspensions in Donnan equilibrium with a salt ion reservoir, and analyze instances where the macroion effective charge becomes larger than the bare one. The methods assessed include single-center cell, jellium, and multi-center mean-field theories. The strengths and weaknesses of the various methods are critically assessed, with the aim of guiding optimal and accurate implementations.


title: Emergence of Nestedness in the Public Internet Peering Ecosystem

abstract: Nestedness is a property of bipartite complex networks that has been shown to characterize the peculiar structure of biological and economical networks. In a nested network, a node of low degree has its neighborhood included in the neighborhood of nodes of higher degree. Emergence of nestedness is commonly due to two different schemes: i) mutualistic behavior of nodes, where nodes of each class have an advantage in associating with each other, such as plant pollination or seed dispersal networks; ii) geographic distribution of species, captured in a so-called biogeographic network where species represent one class and geographical areas the other one. Nestedness has useful applications on real-world networks such as node ranking and link prediction. Motivated by analogies with biological networks, we study the nestedness property of the public Internet peering ecosystem, an important part of the Internet where autonomous systems (ASes) exchange traffic at Internet eXchange Points (IXPs). We propose two representations of this ecosystem using a bipartite graph derived from PeeringDB data. The first graph captures the AS [is member of] IXP relationship which is reminiscent of the mutualistic networks. The second graph groups IXPs into countries, and we define the AS [is present at] country relationship to mimic a biogeographic network. We statistically confirm the nestedness property of both graphs, which has never been observed before in Internet topology data. From this unique observation, we show that we can use node metrics to extract new key ASes and make efficient prediction of newly created links over a two-year period.


title: GPT-4 Surpassing Human Performance in Linguistic Pragmatics

abstract: As Large Language Models (LLMs) become increasingly integrated into everyday life, their capabilities to understand and emulate human cognition are under steady examination. This study investigates the ability of LLMs to comprehend and interpret linguistic pragmatics, an aspect of communication that considers context and implied meanings. Using Grice's communication principles, LLMs and human subjects (N=76) were evaluated based on their responses to various dialogue-based tasks. The findings revealed the superior performance and speed of LLMs, particularly GPT4, over human subjects in interpreting pragmatics. GPT4 also demonstrated accuracy in the pre-testing of human-written samples, indicating its potential in text analysis. In a comparative analysis of LLMs using human individual and average scores, the models exhibited significant chronological improvement. The models were ranked from lowest to highest score, with GPT2 positioned at 78th place, GPT3 ranking at 23rd, Bard at 10th, GPT3.5 placing 5th, Best Human scoring 2nd, and GPT4 achieving the top spot. The findings highlight the remarkable progress made in the development and performance of these LLMs. Future studies should consider diverse subjects, multiple languages, and other cognitive aspects to fully comprehend the capabilities of LLMs. This research holds significant implications for the development and application of AI-based models in communication-centered sectors.


title: On a Functional Definition of Intelligence

abstract: Without an agreed-upon definition of intelligence, asking "is this system intelligent?"" is an untestable question. This lack of consensus hinders research, and public perception, on Artificial Intelligence (AI), particularly since the rise of generative- and large-language models. Most work on precisely capturing what we mean by "intelligence" has come from the fields of philosophy, psychology, and cognitive science. Because these perspectives are intrinsically linked to intelligence as it is demonstrated by natural creatures, we argue such fields cannot, and will not, provide a sufficiently rigorous definition that can be applied to artificial means. Thus, we present an argument for a purely functional, black-box definition of intelligence, distinct from how that intelligence is actually achieved; focusing on the "what", rather than the "how". To achieve this, we first distinguish other related concepts (sentience, sensation, agency, etc.) from the notion of intelligence, particularly identifying how these concepts pertain to artificial intelligent systems. As a result, we achieve a formal definition of intelligence that is conceptually testable from only external observation, that suggests intelligence is a continuous variable. We conclude by identifying challenges that still remain towards quantifiable measurement. This work provides a useful perspective for both the development of AI, and for public perception of the capabilities and risks of AI.


title: Decaffe: DHT Tree-Based Online Federated Fake News Detection

abstract: The proliferation of mobile social networks (MSNs) has transformed information dissemination, leading to increased reliance on these platforms for news consumption. However, this shift has been accompanied by the widespread propagation of fake news, posing significant challenges in terms of public panic, political influence, and the obscuring of truth. Traditional data processing pipelines for fake news detection in MSNs suffer from lengthy response times and poor scalability, failing to address the unique characteristics of news in MSNs, such as prompt propagation, large-scale quantity, and rapid evolution. This paper introduces a novel system named Decaffe - a DHT Tree-Based Online Federated Fake News Detection system. Decaffe leverages distributed hash table (DHT)-based aggregation trees for scalability and real-time detection, and it employs two model fine-tuning methods for adapting to mobile network dynamics. The system's structure includes a root, branches, and leaves for effective dissemination of a pre-trained model and ensemble-based aggregation of predictive results. Decaffe uniquely combines centralized server-based and decentralized serverless model fine-tuning approaches with personalized model fine-tuning, addressing the challenges of real-time detection, scalability, and adaptability in the dynamic environment of MSNs.


title: Integrating AI and Learning Analytics for Data-Driven Pedagogical Decisions and Personalized Interventions in Education

abstract: This research study delves into the conceptualization, development, and deployment of an innovative learning analytics tool, leveraging the capabilities of OpenAI's GPT-4 model. This tool is designed to quantify student engagement, map learning progression, and evaluate the efficacy of diverse instructional strategies within an educational context. Through the analysis of various critical data points such as students' stress levels, curiosity, confusion, agitation, topic preferences, and study methods, the tool offers a rich, multi-dimensional view of the learning environment. Furthermore, it employs Bloom's taxonomy as a framework to gauge the cognitive levels addressed by students' questions, thereby elucidating their learning progression. The information gathered from these measurements can empower educators by providing valuable insights to enhance teaching methodologies, pinpoint potential areas for improvement, and craft personalized interventions for individual students. The study articulates the design intricacies, implementation strategy, and thorough evaluation of the learning analytics tool, underscoring its prospective contributions to enhancing educational outcomes and bolstering student success. Moreover, the practicalities of integrating the tool within existing educational platforms and the requisite robust, secure, and scalable technical infrastructure are addressed. This research opens avenues for harnessing AI's potential in shaping the future of education, facilitating data-driven pedagogical decisions, and ultimately fostering a more conducive, personalized learning environment.


title: Wormholes in the Non-minimally Coupled Gravity with Electromagnetism

abstract: Wormholes are geometric passages in spacetime which can connect two faraway regions of the same universe or two different universes with a shortcut. Although they are currently considered as hypothetical, they might be important observable structures that allow even time travel. But their general relativistic construction requires an exotic matter with negative energy density. The construction of wormholes containing realistic matter is a very important challenge. Therefore, in this work we investigate wormholes in the model which is non-minimally coupled electromagnetic fields to gravity. Then we give some traversable wormhole geometries with realistic matter.


title: Electromagnetic field in a cavity induced by gravitational waves

abstract: The detection method of gravitational waves (GW) using electromagnetic (EM) cavities has garnered significant attention in recent years. This paper thoroughly examines the analysis for the perturbation of the EM field and raises some issues in the existing literature. Our work demonstrates that the rigid condition imposed on the material, as provided in the literature, is inappropriate due to its reliance on a gauge-dependent quantity that cannot be controlled experimentally. Instead, we incorporate elasticity into the material and revise the governing equations for the electric field induced by GWs, expressing them solely in terms of gauge-invariant quantities. Applying these equations to a cylindrical cavity with the TM010 mode, we present the GW antenna pattern for the detector.


title: Learning-based Axial Video Motion Magnification

abstract: Video motion magnification amplifies invisible small motions to be perceptible, which provides humans with a spatially dense and holistic understanding of small motions in the scene of interest. This is based on the premise that magnifying small motions enhances the legibility of motions. In the real world, however, vibrating objects often possess convoluted systems that have complex natural frequencies, modes, and directions. Existing motion magnification often fails to improve legibility since the intricate motions still retain complex characteristics even after being magnified, which may distract us from analyzing them. In this work, we focus on improving legibility by proposing a new concept, axial motion magnification, which magnifies decomposed motions along the user-specified direction. Axial motion magnification can be applied to various applications where motions of specific axes are critical, by providing simplified and easily readable motion information. To achieve this, we propose a novel Motion Separation Module that enables to disentangle and magnify the motion representation along axes of interest. Furthermore, we build a new synthetic training dataset for the axial motion magnification task. Our proposed method improves the legibility of resulting motions along certain axes by adding a new feature: user controllability. Axial motion magnification is a more generalized concept; thus, our method can be directly adapted to the generic motion magnification and achieves favorable performance against competing methods.


title: The number of inscribed and circumscribed graphs of a convex polyhedron

abstract: In the paper we prove that the number of graphs inscribed into graph of a convex polyhedron and circumscribed around another graph does not exceed 4. For this we first studied Poncelet type problem about the number of convex $n$-gons inscribed into one convex $n$-gon and circumscribed around another convex $n$-gon. It is proved that their number is also at most 4. This contrasts with Poncelet type porisms where usually infinitude of such polygons is proved, provided that one such polygon already exists. An inequality involving ratio of lengths of line segments is used. Alternative way of using Maclaurin-Braikenridge's conic generation method is also discussed. Properties related to constructibility with straightedge and compass are also studied. A new proof, based on mathematical induction, of generalized Maclaurin- Braikenridge's theorem is given. We also gave examples of regular polygons and a polyhedron for which number 4 is realized.


title: Prompt-based Distribution Alignment for Unsupervised Domain Adaptation

abstract: Recently, despite the unprecedented success of large pre-trained visual-language models (VLMs) on a wide range of downstream tasks, the real-world unsupervised domain adaptation (UDA) problem is still not well explored. Therefore, in this paper, we first experimentally demonstrate that the unsupervised-trained VLMs can significantly reduce the distribution discrepancy between source and target domains, thereby improving the performance of UDA. However, a major challenge for directly deploying such models on downstream UDA tasks is prompt engineering, which requires aligning the domain knowledge of source and target domains, since the performance of UDA is severely influenced by a good domain-invariant representation. We further propose a Prompt-based Distribution Alignment (PDA) method to incorporate the domain knowledge into prompt learning. Specifically, PDA employs a two-branch prompt-tuning paradigm, namely base branch and alignment branch. The base branch focuses on integrating class-related representation into prompts, ensuring discrimination among different classes. To further minimize domain discrepancy, for the alignment branch, we construct feature banks for both the source and target domains and propose image-guided feature tuning (IFT) to make the input attend to feature banks, which effectively integrates self-enhanced and cross-domain features into the model. In this way, these two branches can be mutually promoted to enhance the adaptation of VLMs for UDA. We conduct extensive experiments on three benchmarks to demonstrate that our proposed PDA achieves state-of-the-art performance. The code is available at https://github.com/BaiShuanghao/Prompt-based-Distribution-Alignment.


title: Embodied Adversarial Attack: A Dynamic Robust Physical Attack in Autonomous Driving

abstract: As physical adversarial attacks become extensively applied in unearthing the potential risk of security-critical scenarios, especially in autonomous driving, their vulnerability to environmental changes has also been brought to light. The non-robust nature of physical adversarial attack methods brings less-than-stable performance consequently. To enhance the robustness of physical adversarial attacks in the real world, instead of statically optimizing a robust adversarial example via an off-line training manner like the existing methods, this paper proposes a brand new robust adversarial attack framework: Embodied Adversarial Attack (EAA) from the perspective of dynamic adaptation, which aims to employ the paradigm of embodied intelligence: Perception-Decision-Control to dynamically adjust the optimal attack strategy according to the current situations in real time. For the perception module, given the challenge of needing simulation for the victim's viewpoint, EAA innovatively devises a Perspective Transformation Network to estimate the target's transformation from the attacker's perspective. For the decision and control module, EAA adopts the laser-a highly manipulable medium to implement physical attacks, and further trains an attack agent with reinforcement learning to make it capable of instantaneously determining the best attack strategy based on the perceived information. Finally, we apply our framework to the autonomous driving scenario. A variety of experiments verify the high effectiveness of our method under complex scenes.


title: Stress correlations in near-crystalline packings

abstract: We derive exact results for stress correlations in near-crystalline systems in two and three dimensions. We study energy minimized configurations of particles interacting through Harmonic as well as Lennard-Jones potentials, for varying degrees of microscopic disorder and quenched forces on grains. Our findings demonstrate that the macroscopic elastic properties of such near-crystalline packings remain unchanged within a certain disorder threshold, yet they can be influenced by various factors, including packing density, pressure, and the strength of inter-particle interactions. We show that the stress correlations in such systems display anisotropic behavior at large lengthscales and are significantly influenced by the pre-stress of the system. The anisotropic nature of these correlations remains unaffected as we increase the strength of the disorder. Additionally, we derive the large lengthscale behavior for the change in the local stress components that shows a $1/r^d$ radial decay for the case of particle size disorder and a $1/r^{d-1}$ behavior for quenched forces introduced into a crystalline network. Finally, we verify our theoretical results numerically using energy-minimised static particle configurations.

categories: cond-mat.soft cond-mat.stat-mech math-ph math.MP


title: Optical Ranging Using Coherent Kerr Soliton Dual-microcombs with Extended Ambiguity Distance

abstract: Optical ranging is a key technology in metrology. Optical frequency combs are shown to provide several advantages in light ranging, offering high precision with high acquisition rate. However, performance of traditional ranging systems based on microcombs is limited by the short ambiguity distance and non-real-time processing. Here, we show that dual-comb ranging system using coherent Kerr soliton microcombs and optical switch realizes extended ambiguity distance and provides a route to real-time processing. The ambguity distance is extended to 3.28 m from about 1.5 mm and the uncertainty reaches about 1.05 times 10^-7, while the system is compatible with low-bandwidth detectors. Combining coherent microcomb ranging systems with special FPGA could enable comb-based real-time ranging systems for several applications such as industrial process monitoring.


title: Quantifying macrostructures in viscoelastic sub-diffusive flows

abstract: We present a theory to quantify the formation of spatiotemporal macrostructures (or the non-homogeneous regions of high viscosity at moderate to high fluid inertia) for viscoelastic sub-diffusive flows, by introducing a mathematically consistent decomposition of the polymer conformation tensor, into the so-called structure tensor. Our approach bypasses an inherent problem in the standard arithmetic decomposition, namely, the fluctuating conformation tensor fields may not be positive definite and hence, do not retain their physical meaning. Using well-established results in matrix analysis, the space of positive definite matrices is transformed into a Riemannian manifold by defining and constructing a geodesic via the inner product on its tangent space. This geodesic is utilized to define three scalar invariants of the structure tensor, which do not suffer from the caveats of the regular invariants (such as trace and determinant) of the polymer conformation tensor. First, we consider the problem of formulating perturbative expansions of the structure tensor using the geodesic, which is consistent with the Riemannian manifold geometry. A constraint on the maximum time, during which the evolution of the perturbative solution can be well approximated by linear theory along the Euclidean manifold, is found. Finally, direct numerical simulations of the viscoelastic sub-diffusive channel flows (where the stress-constitutive law is obtained via coarse-graining the polymer relaxation spectrum at finer scale, Chauhan et. al., Phys. Fluids, DOI: 10.1063/5.0174598 (2023)), underscore the advantage of using these invariants in effectively quantifying the macrostructures.


title: Towards Transferable Targeted 3D Adversarial Attack in the Physical World

abstract: Compared with transferable untargeted attacks, transferable targeted adversarial attacks could specify the misclassification categories of adversarial samples, posing a greater threat to security-critical tasks. In the meanwhile, 3D adversarial samples, due to their potential of multi-view robustness, can more comprehensively identify weaknesses in existing deep learning systems, possessing great application value. However, the field of transferable targeted 3D adversarial attacks remains vacant. The goal of this work is to develop a more effective technique that could generate transferable targeted 3D adversarial examples, filling the gap in this field. To achieve this goal, we design a novel framework named TT3D that could rapidly reconstruct from few multi-view images into Transferable Targeted 3D textured meshes. While existing mesh-based texture optimization methods compute gradients in the high-dimensional mesh space and easily fall into local optima, leading to unsatisfactory transferability and distinct distortions, TT3D innovatively performs dual optimization towards both feature grid and Multi-layer Perceptron (MLP) parameters in the grid-based NeRF space, which significantly enhances black-box transferability while enjoying naturalness. Experimental results show that TT3D not only exhibits superior cross-model transferability but also maintains considerable adaptability across different renders and vision tasks. More importantly, we produce 3D adversarial examples with 3D printing techniques in the real world and verify their robust performance under various scenarios.


title: STEAM & MoSAFE: SOTIF Error-and-Failure Model & Analysis for AI-Enabled Driving Automation

abstract: Driving Automation Systems (DAS) are subject to complex road environments and vehicle behaviors and increasingly rely on sophisticated sensors and Artificial Intelligence (AI). These properties give rise to unique safety faults stemming from specification insufficiencies and technological performance limitations, where sensors and AI introduce errors that vary in magnitude and temporal patterns, posing potential safety risks. The Safety of the Intended Functionality (SOTIF) standard emerges as a promising framework for addressing these concerns, focusing on scenario-based analysis to identify hazardous behaviors and their causes. Although the current standard provides a basic cause-and-effect model and high-level process guidance, it lacks concepts required to identify and evaluate hazardous errors, especially within the context of AI. This paper introduces two key contributions to bridge this gap. First, it defines the SOTIF Temporal Error and Failure Model (STEAM) as a refinement of the SOTIF cause-and-effect model, offering a comprehensive system-design perspective. STEAM refines error definitions, introduces error sequences, and classifies them as error sequence patterns, providing particular relevance to systems employing advanced sensors and AI. Second, this paper proposes the Model-based SOTIF Analysis of Failures and Errors (MoSAFE) method, which allows instantiating STEAM based on system-design models by deriving hazardous error sequence patterns at module level from hazardous behaviors at vehicle level via weakest precondition reasoning. Finally, the paper presents a case study centered on an automated speed-control feature, illustrating the practical applicability of the refined model and the MoSAFE method in addressing complex safety challenges in DAS.


title: Arithmetic springer theorem and $n$-universality under field extensions

abstract: Based on BONGs theory, we prove the norm principle for integral and relative integral spinor norms of quadratic forms over general dyadic local fields, respectively. By virtue of these results, we further establish the arithmetic version of Springer's theorem for indefinite quadratic forms. Moreover, we solve the lifting problems on $n$-universality over arbitrary local fields.


title: Investigating Responsible AI for Scientific Research: An Empirical Study

abstract: Scientific research organizations that are developing and deploying Artificial Intelligence (AI) systems are at the intersection of technological progress and ethical considerations. The push for Responsible AI (RAI) in such institutions underscores the increasing emphasis on integrating ethical considerations within AI design and development, championing core values like fairness, accountability, and transparency. For scientific research organizations, prioritizing these practices is paramount not just for mitigating biases and ensuring inclusivity, but also for fostering trust in AI systems among both users and broader stakeholders. In this paper, we explore the practices at a research organization concerning RAI practices, aiming to assess the awareness and preparedness regarding the ethical risks inherent in AI design and development. We have adopted a mixed-method research approach, utilising a comprehensive survey combined with follow-up in-depth interviews with selected participants from AI-related projects. Our results have revealed certain knowledge gaps concerning ethical, responsible, and inclusive AI, with limitations in awareness of the available AI ethics frameworks. This revealed an overarching underestimation of the ethical risks that AI technologies can present, especially when implemented without proper guidelines and governance. Our findings reveal the need for a holistic and multi-tiered strategy to uplift capabilities and better support science research teams for responsible, ethical, and inclusive AI development and deployment.


title: Collision Course for Objects Moving on a Spherical Manifold

abstract: In this paper, we address the problem of predicting collision for objects moving on the surface of a spherical manifold. Toward this end, we develop the notion of a collision triangle on such manifolds. We use this to determine analytical conditions governing the speed ratios and direcions of motion of objects that lead to collisions on the sphere. We first develop these conditions for point objects and subsequently extend this to the case of circular patch shaped objects moving on the sphere.


title: Variational Quantum Domain Adaptation

abstract: Quantum machine learning is an important application of quantum computing in the era of noisy intermediate-scale quantum devices. Domain adaptation is an effective method for addressing the distribution discrepancy problem between the training data and the real data when the neural network model is deployed. In this paper, a variational quantum domain adaptation method is proposed by using a quantum convolutional neural network, together with a gradient reversal module, and two quantum fully connected layers, named variational quantum domain adaptation(VQDA). The simulations on the local computer and IBM Quantum Experience (IBM Q) platform by Qiskit show the effectiveness of the proposed method. The results demonstrate that, compared to its classical corresponding domain adaptation method, VQDA achieves an average improvement of 4% on the accuracy for MNIST to USPS domain transfer under the same parameter scales. Similarly, for SYNDigits to SVHN domain transfer, VQDA achieves an average improvement of 2% on the accuracy under the same parameter scales.


title: Exploiting Library Vulnerability via Migration Based Automating Test Generation

abstract: In software development, developers extensively utilize third-party libraries to avoid implementing existing functionalities. When a new third-party library vulnerability is disclosed, project maintainers need to determine whether their projects are affected by the vulnerability, which requires developers to invest substantial effort in assessment. However, existing tools face a series of issues: static analysis tools produce false alarms, dynamic analysis tools require existing tests and test generation tools have low success rates when facing complex vulnerabilities. Vulnerability exploits, as code snippets provided for reproducing vulnerabilities after disclosure, contain a wealth of vulnerability-related information. This study proposes a new method based on vulnerability exploits, called VESTA (Vulnerability Exploit-based Software Testing Auto-Generator), which provides vulnerability exploit tests as the basis for developers to decide whether to update dependencies. VESTA extends the search-based test generation methods by adding a migration step, ensuring the similarity between the generated test and the vulnerability exploit, which increases the likelihood of detecting potential library vulnerabilities in a project. We perform experiments on 30 vulnerabilities disclosed in the past five years, involving 60 vulnerability-project pairs, and compare the experimental results with the baseline method, TRANSFER. The success rate of VESTA is 71.7\% which is a 53.4\% improvement over TRANSFER in the effectiveness of verifying exploitable vulnerabilities.


title: Optimized Control Invariance Conditions for Uncertain Input-Constrained Nonlinear Control Systems

abstract: Providing safety guarantees for learning-based controllers is important for real-world applications. One approach to realizing safety for arbitrary control policies is safety filtering. If necessary, the filter modifies control inputs to ensure that the trajectories of a closed-loop system stay within a given state constraint set for all future time, referred to as the set being positive invariant or the system being safe. Under the assumption of fully known dynamics, safety can be certified using control barrier functions (CBFs). However, the dynamics model is often either unknown or only partially known in practice. Learning-based methods have been proposed to approximate the CBF condition for unknown or uncertain systems from data; however, these techniques do not account for input constraints and, as a result, may not yield a valid CBF condition to render the safe set invariant. In this work, we study conditions that guarantee control invariance of the system under input constraints and propose an optimization problem to reduce the conservativeness of CBF-based safety filters. Building on these theoretical insights, we further develop a probabilistic learning approach that allows us to build a safety filter that guarantees safety for uncertain, input-constrained systems with high probability. We demonstrate the efficacy of our proposed approach in simulation and real-world experiments on a quadrotor and show that we can achieve safe closed-loop behavior for a learned system while satisfying state and input constraints.


title: Summation of Divergent Series and Quantum Phase Transitions in Kitaev Chains with Long-Range Hopping

abstract: We study the quantum phase transitions (QPTs) in extended Kitaev chains with long-range ($1/r^{\alpha}$) hopping. Formally, there are two QPT points at $\mu=\mu_0(\alpha)$ and $\mu_\pi(\alpha)$ ($\mu$ is the chemical potential) which correspond to the summations of $\sum_{m=1}^{\infty}m^{-\alpha}$ and $\sum_{m=1}^{\infty}(-1)^{m-1}m^{-\alpha}$, respectively. When $\alpha\leq0$, both the series are divergent and it is usually believed that no QPTs exist. However, we find that there are two QPTs at $\mu=\mu_0(0)$ and $\mu_\pi(0)$ for $\alpha=0$ and one QPT at $\mu=\mu_\pi(\alpha)$ for $\alpha<0$. These QPTs are second order. The $\mu_0(0)$ and $\mu_\pi(\alpha\leq0)$ correspond to the summations of the divergent series obtained by the analytic continuation of the Riemann $\zeta$ function and Dirichlet $\eta$ function. Moreover, it is found that the quasiparticle energy spectra are discontinue functions of the wave vector $k$ and divide into two branches. This is quite different from that in the case of $\alpha>0$ and induces topological phases with the winding number $\omega:=\pm1/2$. At the same time, the von Neumann entropy are power law of the subchain length $L$ no matter in the gapped region or not. In addition, we also study the QPTs, topological properties, and von Neumann entropy of the systems with $\alpha>0$.


title: Discovery of a large-scale H I plume in the NGC 7194 Group

abstract: We present the discovery of a new H I structure in the NGC 7194 group from the observations using the Karl G. Jansky Very Large Array. NGC 7194 group is a nearby (z ~ 0.027) small galaxy group with five quiescent members. The observations reveal a 200 kpc-long H I plume that spans the entire group with a total mass of M$_{HI}$ = 3.4 x 10$^{10}$ M$_{\odot}$. The line-of-sight velocity of the H I gas gradually increases from south (7200 km s$^{-1}$) to north (8200 km $^{-1}$), and the local velocity dispersion is up to 70 km s$^{-1}$. The structure is not spatially coincident with any member galaxies but it shows close associations with a number of blue star-forming knots. Intragroup H I gas is not rare, but this particular structure is still one of the unusual cases in the sense that it does not show any clear connection with sizable galaxies in the group. We discuss the potential origins of this large-scale H I gas in the NGC 7194 group and its relation with the intergalactic star-forming knots. We propose that this HI feature could have originated from tidal interactions among group members or the infall of a late-type galaxy into the group. Alternatively, it might be leftover gas from flyby intruders.


title: Advancing large-scale thin-film PPLN nonlinear photonics with segmented tunable micro-heaters

abstract: Thin-film periodically poled lithium niobate (TF-PPLN) devices have recently gained prominence for efficient wavelength conversion processes in both classical and quantum applications. However, the patterning and poling of TF-PPLN devices today are mostly performed at chip scales, presenting a significant bottleneck for future large-scale nonlinear photonic systems that require the integration of multiple nonlinear components with consistent performance and low cost. Here, we take a pivotal step towards this goal by developing a wafer-scale TF-PPLN nonlinear photonic platform, leveraging ultraviolet stepper lithography and an automated poling process. To address the inhomogeneous broadening of the quasi-phase matching (QPM) spectrum induced by film thickness variations across the wafer, we propose and demonstrate segmented thermal optic tuning modules that can precisely adjust and align the QPM peak wavelengths in each section. \hl{Using the segmented micro-heaters, we show the successful realignment of inhomogeneously broadened multi-peak QPM spectra with up to 57$\%$ enhancement of conversion efficiency. We achieve a high normalized conversion efficiency of 3802$\%$W$^{-1}$cm$^{-2}$ in a 6 mm long PPLN waveguide, recovering 84$\%$ of the theoretically predicted efficiency in this device.} The advanced fabrication techniques and segmented tuning architectures presented herein pave the way for wafer-scale integration of complex functional nonlinear photonic circuits with applications in quantum information processing, precision sensing and metrology, and low-noise-figure optical signal amplification.


title: Sheath Analysis of Conducting Channel Walls in Anode-Layer Hall Thruster with Acceleration Zone Shifted Downstream

abstract: Channel wall sheath thickness in an anode-layer Hall thruster RAIJIN66 was investigated by a two-dimensional hybrid simulation and a one-dimensional sheath model. A hybrid particle-fluid model with the quasineutrality assumption was used to obtain the wall ion flux and plasma property at plasma-sheath edge. The plasma property inside the sheath was estimated by the nonneutral sheath model. The simulated ion wall current density at the channel exit was 100 A/m2, and the estimated sheath thickness was 0.64 mm. If the wall ion current density is reduced to 1/20 of this value, the sheath region will be extended to cover 50\% of the channel width.


title: CAGE: Controllable Articulation GEneration

abstract: We address the challenge of generating 3D articulated objects in a controllable fashion. Currently, modeling articulated 3D objects is either achieved through laborious manual authoring, or using methods from prior work that are hard to scale and control directly. We leverage the interplay between part shape, connectivity, and motion using a denoising diffusion-based method with attention modules designed to extract correlations between part attributes. Our method takes an object category label and a part connectivity graph as input and generates an object's geometry and motion parameters. The generated objects conform to user-specified constraints on the object category, part shape, and part articulation. Our experiments show that our method outperforms the state-of-the-art in articulated object generation, producing more realistic objects while conforming better to user constraints. Video Summary at: http://youtu.be/cH_rbKbyTpE


title: Extending Context Window of Large Language Models via Semantic Compression

abstract: Transformer-based Large Language Models (LLMs) often impose limitations on the length of the text input to ensure the generation of fluent and relevant responses. This constraint restricts their applicability in scenarios involving long texts. We propose a novel semantic compression method that enables generalization to texts that are 6-8 times longer, without incurring significant computational costs or requiring fine-tuning. Our proposed framework draws inspiration from source coding in information theory and employs a pre-trained model to reduce the semantic redundancy of long inputs before passing them to the LLMs for downstream tasks. Experimental results demonstrate that our method effectively extends the context window of LLMs across a range of tasks including question answering, summarization, few-shot learning, and information retrieval. Furthermore, the proposed semantic compression method exhibits consistent fluency in text generation while reducing the associated computational overhead.


title: IR-UWB Radar-Based Contactless Silent Speech Recognition of Vowels, Consonants, Words, and Phrases

abstract: Several sensing techniques have been proposed for silent speech recognition (SSR); however, many of these methods require invasive processes or sensor attachment to the skin using adhesive tape or glue, rendering them unsuitable for frequent use in daily life. By contrast, impulse radio ultra-wideband (IR-UWB) radar can operate without physical contact with users' articulators and related body parts, offering several advantages for SSR. These advantages include high range resolution, high penetrability, low power consumption, robustness to external light or sound interference, and the ability to be embedded in space-constrained handheld devices. This study demonstrated IR-UWB radar-based contactless SSR using four types of speech stimuli (vowels, consonants, words, and phrases). To achieve this, a novel speech feature extraction algorithm specifically designed for IR-UWB radar-based SSR is proposed. Each speech stimulus is recognized by applying a classification algorithm to the extracted speech features. Two different algorithms, multidimensional dynamic time warping (MD-DTW) and deep neural network-hidden Markov model (DNN-HMM), were compared for the classification task. Additionally, a favorable radar antenna position, either in front of the user's lips or below the user's chin, was determined to achieve higher recognition accuracy. Experimental results demonstrated the efficacy of the proposed speech feature extraction algorithm combined with DNN-HMM for classifying vowels, consonants, words, and phrases. Notably, this study represents the first demonstration of phoneme-level SSR using contactless radar.


title: Infrared anomalies in ultrathin Ti3C2Tx MXene films

abstract: Visible transparent but infrared reflective materials are ideal candidates for both transparent conductive films and low-emissivity glass, which are highly desired in a broad variety of areas such as touchscreens and displays, photovoltaics, smart windows, and antistatic coatings. Ultrathin Ti3C2Tx MXene films are emerging as promising low-emissivity transparent candidates. However, the fundamental IR properties of Ti3C2Tx has not been revealed experimentally due to daunting challenges in the preparation of continuous, large-area, and ultrathin films of optical quality on flat substrates. Herein, we proposed a tape-free transfer method that can help prepare centimeter-size and ultrathin (down to 8 nm) Ti3C2Tx films on diverse optical substrates. Benefitting from this method, the refractive index and permittivity for Ti3C2Tx were successfully measured. Ti3C2Tx films exhibit large in-plane permittivity in the IR region, yielding maximum IR reflectance of 88% for bulk films. Interestingly, three anomalies were found in ultrathin Ti3C2Tx films: strong dispersion in the permittivity, interlayer space-dependent optical properties, and abnormally high IR absorption for a 15-nm-thick film. These anomalies are important guidelines in the design of Ti3C2Tx-based low-emissivity transparent films and other related devices, and may inspire other intriguing applications such as ultrathin IR absorption coatings and tunable IR optical devices.


title: Unrevealing hardening and strengthening mechanisms in high-entropy ceramics from lattice distortion

abstract: Revealing the hardening and strengthening mechanisms is crucial for facilitating the design of superhard and high-strength high-entropy ceramics (HECs). Here, we take high-entropy diborides (HEB$_2$) as the prototype to thoroughly investigate the hardening and strengthening mechanisms of HECs. Specifically, the equiatomic 4- to 9-cation single-phase HEB$_2$ ceramics (4-9HEB$_2$) are fabricated by an ultra-fast high-temperature sintering method. The as-fabricated 4-9HEB$_2$ samples possess similar grain sizes, comparable relative densities (up to ~98%), uniform compositions, and clean grain boundaries without any impurities. The experimental results show that the hardness and flexural strength of the as-fabricated 4-9HEB$_2$ samples have an increasing tendency with the increase of metal components. The first-principles calculations find that lattice distortion is essential to the hardness and strength of HEB$_2$. With the increase of metal components, an aggravation of lattice distortion accompanied by B-B bond strengthening is determined, resulting in the enhancement of the hardness and flexural strength. Moreover, the correlation between other potential indicators and the hardness/flexural strength of HEB$_2$ has been disproved, including valence electron concentration, electronegativity mismatch, and metallic states. Our results unravel the hardening and strengthening mechanisms of HECs by intensifying lattice distortion, which may provide guidance for developing superhard and high-strength HECs.


title: Climate-dependent enhancement of radiative cooling with mirror structures

abstract: Radiative cooling exploits the imbalance between the thermal emission from the radiative cooling surface and the downward atmospheric emission. Since the atmospheric emission power is polar angle-dependent, a mirror structure can be used to increase this imbalance and to amplify the net cooling power. The degree of amplification is determined by various parameters such as the sky emissivity, the geometry of the mirror structure and the degree of thermal insulation. A parametric study of the aperture mirror-enhanced radiative cooling is presented using a model atmosphere, characterized by an average sky window emissivity and the ambient temperature. A counterintuitive finding is obtained, namely that the aperture mirror structure is more effective in the tropics than in the desert, both in terms of the cooling power and the temperature reduction. The power enhancement obtainable from a relatively simple mirror structure can be significant. For example, in the tropics, the cooling power can be enhanced by more than 40%. The aperture mirror structure holds potential to be a practical augmentation to improve the stagnant temperature and the response time of radiative cooling devices.


title: SegRap2023: A Benchmark of Organs-at-Risk and Gross Tumor Volume Segmentation for Radiotherapy Planning of Nasopharyngeal Carcinoma

abstract: Radiation therapy is a primary and effective NasoPharyngeal Carcinoma (NPC) treatment strategy. The precise delineation of Gross Tumor Volumes (GTVs) and Organs-At-Risk (OARs) is crucial in radiation treatment, directly impacting patient prognosis. Previously, the delineation of GTVs and OARs was performed by experienced radiation oncologists. Recently, deep learning has achieved promising results in many medical image segmentation tasks. However, for NPC OARs and GTVs segmentation, few public datasets are available for model development and evaluation. To alleviate this problem, the SegRap2023 challenge was organized in conjunction with MICCAI2023 and presented a large-scale benchmark for OAR and GTV segmentation with 400 Computed Tomography (CT) scans from 200 NPC patients, each with a pair of pre-aligned non-contrast and contrast-enhanced CT scans. The challenge's goal was to segment 45 OARs and 2 GTVs from the paired CT scans. In this paper, we detail the challenge and analyze the solutions of all participants. The average Dice similarity coefficient scores for all submissions ranged from 76.68\% to 86.70\%, and 70.42\% to 73.44\% for OARs and GTVs, respectively. We conclude that the segmentation of large-size OARs is well-addressed, and more efforts are needed for GTVs and small-size or thin-structure OARs. The benchmark will remain publicly available here: https://segrap2023.grand-challenge.org


title: Enhancing Data Lakes with GraphAr: Efficient Graph Data Management with a Specialized Storage Scheme

abstract: Data lakes, increasingly adopted for their ability to store and analyze diverse types of data, commonly use columnar storage formats like Parquet and ORC for handling relational tables. However, these traditional setups fall short when it comes to efficiently managing graph data, particularly those conforming to the Labeled Property Graph (LPG) model. To address this gap, this paper introduces GraphAr, a specialized storage scheme designed to enhance existing data lakes for efficient graph data management. Leveraging the strengths of Parquet, GraphAr captures LPG semantics precisely and facilitates graph-specific operations such as neighbor retrieval and label filtering. Through innovative data organization, encoding, and decoding techniques, GraphAr dramatically improves performance. Our evaluations reveal that GraphAr outperforms conventional Parquet and Acero-based methods, achieving an average speedup of $3283\times$ for neighbor retrieval, $6.0\times$ for label filtering, and $29.5\times$ for end-to-end workloads. These findings highlight GraphAr's potential to extend the utility of data lakes by enabling efficient graph data management.


title: Self-Supervised Learning for Anomalous Sound Detection

abstract: State-of-the-art anomalous sound detection (ASD) systems are often trained by using an auxiliary classification task to learn an embedding space. Doing so enables the system to learn embeddings that are robust to noise and are ignoring non-target sound events but requires manually annotated meta information to be used as class labels. However, the less difficult the classification task becomes, the less informative are the embeddings and the worse is the resulting ASD performance. A solution to this problem is to utilize self-supervised learning (SSL). In this work, feature exchange (FeatEx), a simple yet effective SSL approach for ASD, is proposed. In addition, FeatEx is compared to and combined with existing SSL approaches. As the main result, a new state-of-the-art performance for the DCASE2023 ASD dataset is obtained that outperforms all other published results on this dataset by a large margin.


title: MobileSAMv2: Faster Segment Anything to Everything

abstract: Segment anything model (SAM) addresses two practical yet challenging segmentation tasks: \textbf{segment anything (SegAny)}, which utilizes a certain point to predict the mask for a single object of interest, and \textbf{segment everything (SegEvery)}, which predicts the masks for all objects on the image. What makes SegAny slow for SAM is its heavyweight image encoder, which has been addressed by MobileSAM via decoupled knowledge distillation. The efficiency bottleneck of SegEvery with SAM, however, lies in its mask decoder because it needs to first generate numerous masks with redundant grid-search prompts and then perform filtering to obtain the final valid masks. We propose to improve its efficiency by directly generating the final masks with only valid prompts, which can be obtained through object discovery. Our proposed approach not only helps reduce the total time on the mask decoder by at least 16 times but also achieves superior performance. Specifically, our approach yields an average performance boost of 3.6\% (42.5\% \textit{v.s.} 38.9\%) for zero-shot object proposal on the LVIS dataset with the mask AR@$K$ metric. Qualitative results show that our approach generates fine-grained masks while avoiding over-segmenting things. This project targeting faster SegEvery than the original SAM is termed MobileSAMv2 to differentiate from MobileSAM which targets faster SegAny. Moreover, we demonstrate that our new prompt sampling is also compatible with the distilled image encoders in MobileSAM, contributing to a unified framework for efficient SegAny and SegEvery. The code is available at the same link as MobileSAM Project \href{https://github.com/ChaoningZhang/MobileSAM}{\textcolor{red}{https://github.com/ChaoningZhang/MobileSAM}}. \end{abstract}


title: A 1.6-mW Sparse Deep Learning Accelerator for Speech Separation

abstract: Low power deep learning accelerators on the speech processing enable real-time applications on edge devices. However, most of the existing accelerators suffer from high power consumption and focus on image applications only. This paper presents a low power accelerator for speech separation through algorithm and hardware optimizations. At the algorithm level, the model is compressed with structured sensitivity as well as unstructured pruning, and further quantized to the shifted 8-bit floating-point format instead of the 32-bit floating-point format. The computations with the zero kernel and zero activation values are skipped by decomposition of the dilated and transposed convolutions. At the hardware level, the compressed model is then supported by an architecture with eight independent multipliers and accumulators (MACs) with a simple zero-skipping hardware to take advantage of the activation sparsity and low power processing. The proposed approach reduces the model size by 95.44\% and computation complexity by 93.88\%. The final implementation with the TSMC 40 $nm$ process can achieve real-time speech separation and consumes 1.6 mW power when operated at 150 MHz. The normalized energy efficiency and area efficiency are 2.344 TOPS/W and 14.42 GOPS/mm$^2$, respectively.


title: Directional synchrony among self-propelled particles under spatial influence

abstract: Synchronization is one of the emerging collective phenomena in interacting particle systems. Its ubiquitous presence in nature, science, and technology has fascinated the scientific community over the decades. Moreover, a great deal of research has been, and is still being, devoted to understand various physical aspects of the subject. In particular, the study of interacting \textit{active} particles has led to exotic phase transitions in such systems which have opened up a new research front-line. Motivated by this line of work, in this paper, we study the directional synchrony among self-propelled particles. These particles move inside a bounded region, and crucially their directions are also coupled with spatial degrees of freedom. We assume that the directional coupling between two particles is influenced by the relative spatial distance which changes over time. Furthermore, the nature of the influence is considered to be both short and long-ranged. We explore the phase transition scenario in both the cases and propose an approximation technique which enables us to analytically find the critical transition point. The results are further supported with numerical simulations. Our results have potential importance in the study of active systems like bird flocks, fish schools and swarming robots where spatial influence plays a pertinent role.


title: Phoneme-aware Encoding for Prefix-tree-based Contextual ASR

abstract: In speech recognition applications, it is important to recognize context-specific rare words, such as proper nouns. Tree-constrained Pointer Generator (TCPGen) has shown promise for this purpose, which efficiently biases such words with a prefix tree. While the original TCPGen relies on grapheme-based encoding, we propose extending it with phoneme-aware encoding to better recognize words of unusual pronunciations. As TCPGen handles biasing words as subword units, we propose obtaining subword-level phoneme-aware encoding by using alignment between phonemes and subwords. Furthermore, we propose injecting phoneme-level predictions from CTC into queries of TCPGen so that the model better interprets the phoneme-aware encodings. We conducted ASR experiments with TCPGen for RNN transducer. We observed that proposed phoneme-aware encoding outperformed ordinary grapheme-based encoding on both the English LibriSpeech and Japanese CSJ datasets, demonstrating the robustness of our approach across linguistically diverse languages.


title: Leveraging Language ID to Calculate Intermediate CTC Loss for Enhanced Code-Switching Speech Recognition

abstract: In recent years, end-to-end speech recognition has emerged as a technology that integrates the acoustic, pronunciation dictionary, and language model components of the traditional Automatic Speech Recognition model. It is possible to achieve human-like recognition without the need to build a pronunciation dictionary in advance. However, due to the relative scarcity of training data on code-switching, the performance of ASR models tends to degrade drastically when encountering this phenomenon. Most past studies have simplified the learning complexity of the model by splitting the code-switching task into multiple tasks dealing with a single language and then learning the domain-specific knowledge of each language separately. Therefore, in this paper, we attempt to introduce language identification information into the middle layer of the ASR model's encoder. We aim to generate acoustic features that imply language distinctions in a more implicit way, reducing the model's confusion when dealing with language switching.