title: Deep Support Vectors

abstract: Deep learning has achieved tremendous success. \nj{However,} unlike SVMs, which provide direct decision criteria and can be trained with a small dataset, it still has significant weaknesses due to its requirement for massive datasets during training and the black-box characteristics on decision criteria. \nj{This paper addresses} these issues by identifying support vectors in deep learning models. To this end, we propose the DeepKKT condition, an adaptation of the traditional Karush-Kuhn-Tucker (KKT) condition for deep learning models, and confirm that generated Deep Support Vectors (DSVs) using this condition exhibit properties similar to traditional support vectors. This allows us to apply our method to few-shot dataset distillation problems and alleviate the black-box characteristics of deep learning models. Additionally, we demonstrate that the DeepKKT condition can transform conventional classification models into generative models with high fidelity, particularly as latent \jh{generative} models using class labels as latent variables. We validate the effectiveness of DSVs \nj{using common datasets (ImageNet, CIFAR10 \nj{and} CIFAR100) on the general architectures (ResNet and ConvNet)}, proving their practical applicability. (See Fig.~\ref{fig:generated})


title: Staircase Localization for Autonomous Exploration in Urban Environments

abstract: A staircase localization method is proposed for robots to explore urban environments autonomously. The proposed method employs a modular design in the form of a cascade pipeline consisting of three modules of stair detection, line segment detection, and stair localization modules. The stair detection module utilizes an object detection algorithm based on deep learning to generate a region of interest (ROI). From the ROI, line segment features are extracted using a deep line segment detection algorithm. The extracted line segments are used to localize a staircase in terms of position, orientation, and stair direction. The stair detection and localization are performed only with a single RGB-D camera. Each component of the proposed pipeline does not need to be designed particularly for staircases, which makes it easy to maintain the whole pipeline and replace each component with state-of-the-art deep learning detection techniques. The results of real-world experiments show that the proposed method can perform accurate stair detection and localization during autonomous exploration for various structured and unstructured upstairs and downstairs with shadows, dirt, and occlusions by artificial and natural objects.


title: FedMIL: Federated-Multiple Instance Learning for Video Analysis with Optimized DPP Scheduling

abstract: Many AI platforms, including traffic monitoring systems, use Federated Learning (FL) for decentralized sensor data processing for learning-based applications while preserving privacy and ensuring secured information transfer. On the other hand, applying supervised learning to large data samples, like high-resolution images requires intensive human labor to label different parts of a data sample. Multiple Instance Learning (MIL) alleviates this challenge by operating over labels assigned to the 'bag' of instances. In this paper, we introduce Federated Multiple-Instance Learning (FedMIL). This framework applies federated learning to boost the training performance in video-based MIL tasks such as vehicle accident detection using distributed CCTV networks. However, data sources in decentralized settings are not typically Independently and Identically Distributed (IID), making client selection imperative to collectively represent the entire dataset with minimal clients. To address this challenge, we propose DPPQ, a framework based on the Determinantal Point Process (DPP) with a quality-based kernel to select clients with the most diverse datasets that achieve better performance compared to both random selection and current DPP-based client selection methods even with less data utilization in the majority of non-IID cases. This offers a significant advantage for deployment on edge devices with limited computational resources, providing a reliable solution for training AI models in massive smart sensor networks.


title: Labeling subtypes in a Parkinson's Cohort using Multifeatures in MRI -- Integrating Grey and White Matter Information

abstract: Thresholding of networks has long posed a challenge in brain connectivity analysis. Weighted networks are typically binarized using threshold measures to facilitate network analysis. Previous studies on MRI-based brain networks have predominantly utilized density or sparsity-based thresholding techniques, optimized within specific ranges derived from network metrics such as path length, clustering coefficient, and small-world index. Thus, determination of a single threshold value for facilitating comparative analysis of networks remains elusive. To address this, our study introduces Mutual K-Nearest Neighbor (MKNN)-based thresholding for brain network analysis. Here, nearest neighbor selection is based on the highest correlation between features of brain regions. Construction of brain networks was accomplished by computing Pearson correlations between grey matter volume and white matter volume for each pair of brain regions. Structural MRI data from 180 Parkinsons patients and 70 controls from the NIMHANS, India were analyzed. Subtypes within Parkinsons disease were identified based on grey and white matter volume atrophy using source-based morphometric decomposition. The loading coefficients were correlated with clinical features to discern clinical relationship with the deciphered subtypes. Our data-mining approach revealed: Subtype A (N = 51, intermediate type), Subtype B (N = 57, mild-severe type with mild motor symptoms), and Subtype AB (N = 36, most-severe type with predominance in motor impairment). Subtype-specific weighted matrices were binarized using MKNN-based thresholding for brain network analysis. Permutation tests on network metrics of resulting bipartite graphs demonstrated significant group differences in betweenness centrality and participation coefficient. The identified hubs were specific to each subtype, with some hubs conserved across different subtypes.


title: The Pursuit of Fairness in Artificial Intelligence Models: A Survey

abstract: Artificial Intelligence (AI) models are now being utilized in all facets of our lives such as healthcare, education and employment. Since they are used in numerous sensitive environments and make decisions that can be life altering, potential biased outcomes are a pressing matter. Developers should ensure that such models don't manifest any unexpected discriminatory practices like partiality for certain genders, ethnicities or disabled people. With the ubiquitous dissemination of AI systems, researchers and practitioners are becoming more aware of unfair models and are bound to mitigate bias in them. Significant research has been conducted in addressing such issues to ensure models don't intentionally or unintentionally perpetuate bias. This survey offers a synopsis of the different ways researchers have promoted fairness in AI systems. We explore the different definitions of fairness existing in the current literature. We create a comprehensive taxonomy by categorizing different types of bias and investigate cases of biased AI in different application domains. A thorough study is conducted of the approaches and techniques employed by researchers to mitigate bias in AI models. Moreover, we also delve into the impact of biased models on user experience and the ethical considerations to contemplate when developing and deploying such models. We hope this survey helps researchers and practitioners understand the intricate details of fairness and bias in AI systems. By sharing this thorough survey, we aim to promote additional discourse in the domain of equitable and responsible AI.


title: OVER-NAV: Elevating Iterative Vision-and-Language Navigation with Open-Vocabulary Detection and StructurEd Representation

abstract: Recent advances in Iterative Vision-and-Language Navigation (IVLN) introduce a more meaningful and practical paradigm of VLN by maintaining the agent's memory across tours of scenes. Although the long-term memory aligns better with the persistent nature of the VLN task, it poses more challenges on how to utilize the highly unstructured navigation memory with extremely sparse supervision. Towards this end, we propose OVER-NAV, which aims to go over and beyond the current arts of IVLN techniques. In particular, we propose to incorporate LLMs and open-vocabulary detectors to distill key information and establish correspondence between multi-modal signals. Such a mechanism introduces reliable cross-modal supervision and enables on-the-fly generalization to unseen scenes without the need of extra annotation and re-training. To fully exploit the interpreted navigation data, we further introduce a structured representation, coded Omnigraph, to effectively integrate multi-modal information along the tour. Accompanied with a novel omnigraph fusion mechanism, OVER-NAV is able to extract the most relevant knowledge from omnigraph for a more accurate navigating action. In addition, OVER-NAV seamlessly supports both discrete and continuous environments under a unified framework. We demonstrate the superiority of OVER-NAV in extensive experiments.


title: Cosmic-ray Acceleration in Core-Collapse Supernova Remnants with the Wind Termination Shock

abstract: We investigate the attainable maximum energy of particles accelerated in the core-collapse supernova remnant (SNR) shock propagating in the free wind region with the Parker-spiral magnetic field, current sheet, and the wind termination shock (WTS) by using test particle simulations. This work focuses on Wolf-Rayet stars as progenitors. The magnetic field amplification in the free wind region (shock upstream region) is not considered in this work. Test particle simulations show that particles escaped from the core-collapse SNR reach and move along the WTS, and eventually return to the SNR shock from the poles or equator of the WTS. The particle attainable energy can be boosted by this cyclic motion between the SNR shock and WTS and can be larger than the particle energy that is limited by escape from the SNR shock. The particle energy limited by the cyclic motion between the SNR shock and WTS is about $10-100~{\rm TeV}$. Thus, the core-collapse SNR without upstream magnetic field amplification can be the origin of the break around $10~{\rm TeV}$ of the energy spectrum of observed cosmic ray protons and helium.


title: Don't Listen To Me: Understanding and Exploring Jailbreak Prompts of Large Language Models

abstract: Recent advancements in generative AI have enabled ubiquitous access to large language models (LLMs). Empowered by their exceptional capabilities to understand and generate human-like text, these models are being increasingly integrated into our society. At the same time, there are also concerns on the potential misuse of this powerful technology, prompting defensive measures from service providers. To overcome such protection, jailbreaking prompts have recently emerged as one of the most effective mechanisms to circumvent security restrictions and elicit harmful content originally designed to be prohibited. Due to the rapid development of LLMs and their ease of access via natural languages, the frontline of jailbreak prompts is largely seen in online forums and among hobbyists. To gain a better understanding of the threat landscape of semantically meaningful jailbreak prompts, we systemized existing prompts and measured their jailbreak effectiveness empirically. Further, we conducted a user study involving 92 participants with diverse backgrounds to unveil the process of manually creating jailbreak prompts. We observed that users often succeeded in jailbreak prompts generation regardless of their expertise in LLMs. Building on the insights from the user study, we also developed a system using AI as the assistant to automate the process of jailbreak prompt generation.


title: Destination-Constrained Linear Dynamical System Modeling in Set-Valued Frameworks

abstract: Directional motion towards a specified destination is a common occurrence in physical processes and human societal activities. Utilizing this prior information can significantly improve the control and predictive performance of system models. This paper primarily focuses on reconstructing linear dynamic system models based on destination constraints in the set-valued framework. We treat destination constraints as inherent information in the state evolution process and employ convex optimization techniques to construct a coherent and robust state model. This refined model effectively captures the impact of destination constraints on the state evolution at each time step. Furthermore, we design an optimal weight matrix for the reconstructed model to ensure smoother and more natural trajectories of state evolution. We also analyze the theoretical guarantee of optimality for this weight matrix and the properties of the reconstructed model. Finally, simulation experiments verify that the reconstructed model has significant advantages over the unconstrained and unoptimized weighted models and constrains the evolution of state trajectories with different starting and ending points.


title: Reinforcement Learning-based Receding Horizon Control using Adaptive Control Barrier Functions for Safety-Critical Systems

abstract: Optimal control methods provide solutions to safety-critical problems but easily become intractable. Control Barrier Functions (CBFs) have emerged as a popular technique that facilitates their solution by provably guaranteeing safety, through their forward invariance property, at the expense of some performance loss. This approach involves defining a performance objective alongside CBF-based safety constraints that must always be enforced. Unfortunately, both performance and solution feasibility can be significantly impacted by two key factors: (i) the selection of the cost function and associated parameters, and (ii) the calibration of parameters within the CBF-based constraints, which capture the trade-off between performance and conservativeness. %as well as infeasibility. To address these challenges, we propose a Reinforcement Learning (RL)-based Receding Horizon Control (RHC) approach leveraging Model Predictive Control (MPC) with CBFs (MPC-CBF). In particular, we parameterize our controller and use bilevel optimization, where RL is used to learn the optimal parameters while MPC computes the optimal control input. We validate our method by applying it to the challenging automated merging control problem for Connected and Automated Vehicles (CAVs) at conflicting roadways. Results demonstrate improved performance and a significant reduction in the number of infeasible cases compared to traditional heuristic approaches used for tuning CBF-based controllers, showcasing the effectiveness of the proposed method.


title: Measurement Uncertainty Impact on Koopman Operator Estimation of Power System Dynamics

abstract: Sensor measurements are mission-critical for monitoring and controlling power systems because they provide real-time insight into the grid operating condition; however, confidence in these insights depends greatly on the quality of the sensor data. Uncertainty in sensor measurements is an intrinsic aspect of the measurement process. In this paper, we develop an analytical method to quantify the impact of measurement uncertainties in numerical methods that employ the Koopman operator to identify nonlinear dynamics based on recorded data. In particular, we quantify the confidence interval of each element in the push-forward matrix from which a subset of the Koopman operator's discrete spectrum is estimated. We provide a detailed numerical analysis of the developed method applied to numerical simulations and field data collected from experiments conducted in a megawatt-scale facility at the National Renewable Energy Laboratory.


title: Uniform Preorders and Partial Combinatory Algebras

abstract: Uniform preorders are a class of combinatory representations of Set-indexed preorders that generalize Pieter Hofstra's basic relational objects. An indexed preorder is representable by a uniform preorder if and only if it has as generic predicate. We study the $\exists$-completion of indexed preorders on the level of uniform preorders, and identify a combinatory condition (called 'relational completeness') which characterizes those uniform preorders with finite meets whose $\exists$-completions are triposes. The class of triposes obtained this way contains relative realizability triposes, for which we derive a characterization as a fibrational analogue of the characterization of realizability toposes given in earlier work. Besides relative partial combinatory algebras, the class of relationally complete uniform preorders contains filtered ordered partial combinatory algebras, and it is unclear if there are any others.


title: Rotational Spectrum and First Interstellar Detection of 2-Methoxyethanol Using ALMA Observations of NGC 6334I

abstract: We use both chirped-pulse Fourier transform and frequency modulated absorption spectroscopy to study the rotational spectrum of 2-methoxyethanol in several frequency regions ranging from 8.7-500 GHz. The resulting rotational parameters permitted a search for this molecule in Atacama Large Millimeter/submillimeter Array (ALMA) observations toward the massive protocluster NGC 6334I as well as source B of the low-mass protostellar system IRAS 16293-2422. 25 rotational transitions are observed in the ALMA Band 4 data toward NGC 6334I, resulting in the first interstellar detection of 2-methoxyethanol. A column density of $1.3_{-0.9}^{+1.4} \times 10^{17}$ cm$^{-2}$ is derived at an excitation temperature of $143_{-39}^{+31}$ K. However, molecular signal is not observed in the Band 7 data toward IRAS 16293-2422B and an upper limit column density of $2.5 \times 10^{15}$ cm$^{-2}$ is determined. Various possible formation pathways--including radical recombination and insertion reactions--are discussed. We also investigate physical differences between the two interstellar sources that could result in the observed abundance variations.


title: The Solution for the ICCV 2023 1st Scientific Figure Captioning Challenge

abstract: In this paper, we propose a solution for improving the quality of captions generated for figures in papers. We adopt the approach of summarizing the textual content in the paper to generate image captions. Throughout our study, we encounter discrepancies in the OCR information provided in the official dataset. To rectify this, we employ the PaddleOCR toolkit to extract OCR information from all images. Moreover, we observe that certain textual content in the official paper pertains to images that are not relevant for captioning, thereby introducing noise during caption generation. To mitigate this issue, we leverage LLaMA to extract image-specific information by querying the textual content based on image mentions, effectively filtering out extraneous information. Additionally, we recognize a discrepancy between the primary use of maximum likelihood estimation during text generation and the evaluation metrics such as ROUGE employed to assess the quality of generated captions. To bridge this gap, we integrate the BRIO model framework, enabling a more coherent alignment between the generation and evaluation processes. Our approach ranked first in the final test with a score of 4.49.


title: Residual-based Language Models are Free Boosters for Biomedical Imaging

abstract: In this study, we uncover the unexpected efficacy of residual-based large language models (LLMs) as part of encoders for biomedical imaging tasks, a domain traditionally devoid of language or textual data. The approach diverges from established methodologies by utilizing a frozen transformer block, extracted from pre-trained LLMs, as an innovative encoder layer for the direct processing of visual tokens. This strategy represents a significant departure from the standard multi-modal vision-language frameworks, which typically hinge on language-driven prompts and inputs. We found that these LLMs could boost performance across a spectrum of biomedical imaging applications, including both 2D and 3D visual classification tasks, serving as plug-and-play boosters. More interestingly, as a byproduct, we found that the proposed framework achieved superior performance, setting new state-of-the-art results on extensive, standardized datasets in MedMNIST-2D and 3D. Through this work, we aim to open new avenues for employing LLMs in biomedical imaging and enriching the understanding of their potential in this specialized domain.


title: Disambiguate Entity Matching using Large Language Models through Relation Discovery

abstract: Entity matching is a critical challenge in data integration and cleaning, central to tasks like fuzzy joins and deduplication. Traditional approaches have focused on overcoming fuzzy term representations through methods such as edit distance, Jaccard similarity, and more recently, embeddings and deep neural networks, including advancements from large language models (LLMs) like GPT. However, the core challenge in entity matching extends beyond term fuzziness to the ambiguity in defining what constitutes a "match," especially when integrating with external databases. This ambiguity arises due to varying levels of detail and granularity among entities, complicating exact matches. We propose a novel approach that shifts focus from purely identifying semantic similarities to understanding and defining the "relations" between entities as crucial for resolving ambiguities in matching. By predefining a set of relations relevant to the task at hand, our method allows analysts to navigate the spectrum of similarity more effectively, from exact matches to conceptually related entities.


title: How many bits does your quantum estimation return?

abstract: We give two upper bounds to the mutual information in arbitrary quantum estimation strategies. The first is based on some simple Fourier properties of the estimation apparatus. The second is derived using the first but, interestingly, depends only on the Fisher information of the parameter, so it is valid even beyond quantum estimation. We illustrate the usefulness of these bounds by characterizing the quantum phase estimation algorithm in the presence of noise. In addition, for the noiseless case, we extend the analysis beyond applying the bound and we discuss the optimal entangled and adaptive strategies, clarifying inaccuracies appearing on this topic in the literature.


title: TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videos

abstract: We propose TRAM, a two-stage method to reconstruct a human's global trajectory and motion from in-the-wild videos. TRAM robustifies SLAM to recover the camera motion in the presence of dynamic humans and uses the scene background to derive the motion scale. Using the recovered camera as a metric-scale reference frame, we introduce a video transformer model (VIMO) to regress the kinematic body motion of a human. By composing the two motions, we achieve accurate recovery of 3D humans in the world space, reducing global motion errors by 60% from prior work. https://yufu-wang.github.io/tram4d/


title: Unified Path and Gait Planning for Safe Bipedal Robot Navigation

abstract: Safe path and gait planning are essential for bipedal robots to navigate complex real-world environments. The prevailing approaches often plan the path and gait separately in a hierarchical fashion, potentially resulting in unsafe movements due to neglecting the physical constraints of walking robots. A safety-critical path must not only avoid obstacles but also ensure that the robot's gaits are subject to its dynamic and kinematic constraints. This work presents a novel approach that unifies path planning and gait planning via a Model Predictive Control (MPC) using the Linear Inverted Pendulum (LIP) model representing bipedal locomotion. This approach considers environmental constraints, such as obstacles, and the robot's kinematics and dynamics constraints. By using discrete-time Control Barrier Functions for obstacle avoidance, our approach generates the next foot landing position, ensuring robust walking gaits and a safe navigation path within clustered environments. We validated our proposed approach in simulation using a Digit robot in 20 randomly created environments. The results demonstrate improved performance in terms of safety and robustness when compared to hierarchical path and gait planning frameworks.


title: On three dimensional flows of viscoelastic fluids of Giesekus type

abstract: Viscoelastic rate-type fluids are popular models of choice in many applications involving flows of fluid-like materials with complex micro-structure. A well-developed mathematical theory for the most of these classical fluid models is however missing. The main purpose of this study is to provide a complete proof of long-time and large-data existence of weak solutions to unsteady internal three-dimensional flows of Giesekus fluids subject to a no-slip boundary condition. As a new auxiliary tool, we provide the identification of certain biting limits in the parabolic setting, presented here within the framework of evolutionary Stokes problems. We also generalize the long-time and large-data existence result to higher dimensions, to viscoelastic models with multiple relaxation mechanisms and to viscoelastic models with different type of dissipation.


title: An average intersection estimate for families of diffeomorphisms

abstract: We show that for any sufficiently rich compact family $\mathcal{H}$ of $C^1$ diffeomorphisms of a closed Riemannanian manifold $M$, the average geometric intersection number over $h \in \mathcal{H}$ between $h(V)$ and $W$, for $V, W$ any complementary dimensional submanifolds of $M$, is approximately (i.e. up to a uniform multiplicative error depending only on $\mathcal{H}$) the product of their volumes. We also give a construction showing that such families always exist.


title: The Solution of the Zodiac Killer's 340-Character Cipher

abstract: The case of the Zodiac Killer is one of the most widely known unsolved serial killer cases in history. The unidentified killer murdered five known victims and terrorized the state of California. He also communicated extensively with the press and law enforcement. Besides his murders, Zodiac was known for his use of ciphers. The first Zodiac cipher was solved within a week of its publication, while the second cipher was solved by the authors after 51 years, when it was discovered to be a transposition and homophonic substitution cipher with unusual qualities. In this paper, we detail the historical significance of this cipher and the numerous efforts which culminated in its solution.


title: Learn from Heterophily: Heterophilous Information-enhanced Graph Neural Network

abstract: Under circumstances of heterophily, where nodes with different labels tend to be connected based on semantic meanings, Graph Neural Networks (GNNs) often exhibit suboptimal performance. Current studies on graph heterophily mainly focus on aggregation calibration or neighbor extension and address the heterophily issue by utilizing node features or structural information to improve GNN representations. In this paper, we propose and demonstrate that the valuable semantic information inherent in heterophily can be utilized effectively in graph learning by investigating the distribution of neighbors for each individual node within the graph. The theoretical analysis is carried out to demonstrate the efficacy of the idea in enhancing graph learning. Based on this analysis, we propose HiGNN, an innovative approach that constructs an additional new graph structure, that integrates heterophilous information by leveraging node distribution to enhance connectivity between nodes that share similar semantic characteristics. We conduct empirical assessments on node classification tasks using both homophilous and heterophilous benchmark datasets and compare HiGNN to popular GNN baselines and SoTA methods, confirming the effectiveness in improving graph representations. In addition, by incorporating heterophilous information, we demonstrate a notable enhancement in existing GNN-based approaches, and the homophily degree across real-world datasets, thus affirming the efficacy of our approach.


title: On the Heating of the Slow Solar-Wind by Imbalanced Alfv\'en-Wave Turbulence from 0.06 au to 1 au: Parker Solar Probe and Solar Orbiter observations

abstract: In this work we analyze plasma and magnetic field data provided by the Parker Solar Probe (\emph{PSP}) and Solar Orbiter (\emph{SO}) missions to investigate the radial evolution of the heating of Alfv\'enic slow wind (ASW) by imbalanced Alfv\'en-Wave (AW) turbulent fluctuations from 0.06 au to 1 au. in our analysis we focus on slow solar-wind intervals with highly imbalanced and incompressible turbulence (i.e., magnetic compressibility $C_B=\delta B/B\leq 0.25$, plasma compressibility $C_n=\delta n/n\leq 0.25$ and normalized cross-helicity $\sigma_c\geq 0.65$). First, we estimate the AW turbulent dissipation rate from the wave energy equation and find that the radial profile trend is similar to the proton heating rate. Second, we find that the scaling of the empirical AW turbulent dissipation rate $Q_W$ obtained from the wave energy equation matches the scaling from the phenomenological AW turbulent dissipation rate $Q_{\rm CH09}$ (with $Q_{\rm CH09}\simeq 1.55 Q_W$) derived by~\cite{chandran09} based on the model of reflection-driven turbulence. Our results suggest that, as in the fast solar wind, AW turbulence plays a major role in the ion heating that occurs in incompressible slow-wind streams.


title: Multi-Objective Trajectory Planning with Dual-Encoder

abstract: Time-jerk optimal trajectory planning is crucial in advancing robotic arms' performance in dynamic tasks. Traditional methods rely on solving complex nonlinear programming problems, bringing significant delays in generating optimized trajectories. In this paper, we propose a two-stage approach to accelerate time-jerk optimal trajectory planning. Firstly, we introduce a dual-encoder based transformer model to establish a good preliminary trajectory. This trajectory is subsequently refined through sequential quadratic programming to improve its optimality and robustness. Our approach outperforms the state-of-the-art by up to 79.72\% in reducing trajectory planning time. Compared with existing methods, our method shrinks the optimality gap with the objective function value decreasing by up to 29.9\%.


title: Large topological Hall effect arising from spin reorientation in kagome magnet Fe3Ge

abstract: Materials systems with spin chirality can provide ultra-high-density, ultra-fast, and ultralow-power information carriers for digital transformation. These material systems include magnetic skyrmions, chiral domain walls, spin reorientation,and so on. The topological Hall effect (THE) has been identified as the most convenient and effective tool for detecting the presence of spin chirality in these systems. The research on the THE that may arise from spin reorientation and specifically in Fe3Ge with spin reorientation remains an unexplored area, so we study the THE in Fe3Ge Conduct systematic research. X-Ray Diffraction (XRD) results indicate that our Fe3Ge ribbon sample has a D019 structure. First-principles calculations and magnetic and electrical testing confirm spin reorientation in the Fe3Ge ribbon sample at 350 K.The Hall resistivity test results are consistent with our expectations, indicating the presence of the THE in the Fe3Ge ribbon sample. The topological Hall resistivity reaches a maximum value of 0.69 m{\Omega} cm at 400 K. For the first time, a detailed experimental study of the THE in Fe3Ge with spin reorientation has been conducted, introducing a new member to the family of THE.


title: Emission atomic spectra. Individualized computer simulations of laboratory work

abstract: This paper presents the experience of developing and utilizing computer simulations for student laboratory assignments in atomic physics, specifically focusing on emission atomic spectra. The fundamental component of each laboratory assignment is a computer simulator of a spectrograph, which displays atomic line spectra on the monitor screen. The simulator operates by converting the wavelength of radiation into an RGB triplet. Calibration of the spectrograph is conducted using the atomic spectrum of mercury. The configuration of setup parameters and experimental conditions is unique to each student conducting the laboratory assignment using the simulator. Individualized parameters, stored in Google Sheets, are transferred to the HTML template of the laboratory assignment via the Google Apps Scripts service. This individualization of simulator parameters serves to encourage students to engage in independent work.


title: Trisections of the doubles of some Mazur type 4-manifolds

abstract: We show that certain two kinds of trisection diagrams of the doubles of the Mazur type 4-manifolds introduced by Akbulut and Kirby are standard. One is constructed by doubling a certain relative trisection diagram of the Mazur type. The other is constructed by using an algorithm taking Kirby diagrams to trisection diagrams.


title: MESIA: Understanding and Leveraging Supplementary Nature of Method-level Comments for Automatic Comment Generation

abstract: Code comments are important for developers in program comprehension. In scenarios of comprehending and reusing a method, developers expect code comments to provide supplementary information beyond the method signature. However, the extent of such supplementary information varies a lot in different code comments. In this paper, we raise the awareness of the supplementary nature of method-level comments and propose a new metric named MESIA (Mean Supplementary Information Amount) to assess the extent of supplementary information that a code comment can provide. With the MESIA metric, we conduct experiments on a popular code-comment dataset and three common types of neural approaches to generate method-level comments. Our experimental results demonstrate the value of our proposed work with a number of findings. (1) Small-MESIA comments occupy around 20% of the dataset and mostly fall into only the WHAT comment category. (2) Being able to provide various kinds of essential information, large-MESIA comments in the dataset are difficult for existing neural approaches to generate. (3) We can improve the capability of existing neural approaches to generate large-MESIA comments by reducing the proportion of small-MESIA comments in the training set. (4) The retrained model can generate large-MESIA comments that convey essential meaningful supplementary information for methods in the small-MESIA test set, but will get a lower BLEU score in evaluation. These findings indicate that with good training data, auto-generated comments can sometimes even surpass human-written reference comments, and having no appropriate ground truth for evaluation is an issue that needs to be addressed by future work on automatic comment generation.


title: Addressing Myopic Constrained POMDP Planning with Recursive Dual Ascent

abstract: Lagrangian-guided Monte Carlo tree search with global dual ascent has been applied to solve large constrained partially observable Markov decision processes (CPOMDPs) online. In this work, we demonstrate that these global dual parameters can lead to myopic action selection during exploration, ultimately leading to suboptimal decision making. To address this, we introduce history-dependent dual variables that guide local action selection and are optimized with recursive dual ascent. We empirically compare the performance of our approach on a motivating toy example and two large CPOMDPs, demonstrating improved exploration, and ultimately, safer outcomes.


title: Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models

abstract: We present a Chain-of-Action (CoA) framework for multimodal and retrieval-augmented Question-Answering (QA). Compared to the literature, CoA overcomes two major challenges of current QA applications: (i) unfaithful hallucination that is inconsistent with real-time or domain facts and (ii) weak reasoning performance over compositional information. Our key contribution is a novel reasoning-retrieval mechanism that decomposes a complex question into a reasoning chain via systematic prompting and pre-designed actions. Methodologically, we propose three types of domain-adaptable `Plug-and-Play' actions for retrieving real-time information from heterogeneous sources. We also propose a multi-reference faith score (MRFS) to verify and resolve conflicts in the answers. Empirically, we exploit both public benchmarks and a Web3 case study to demonstrate the capability of CoA over other methods.


title: Activity-Biometrics: Person Identification from Daily Activities

abstract: In this work, we study a novel problem which focuses on person identification while performing daily activities. Learning biometric features from RGB videos is challenging due to spatio-temporal complexity and presence of appearance biases such as clothing color and background. We propose ABNet, a novel framework which leverages disentanglement of biometric and non-biometric features to perform effective person identification from daily activities. ABNet relies on a bias-less teacher to learn biometric features from RGB videos and explicitly disentangle non-biometric features with the help of biometric distortion. In addition, ABNet also exploits activity prior for biometrics which is enabled by joint biometric and activity learning. We perform comprehensive evaluation of the proposed approach across five different datasets which are derived from existing activity recognition benchmarks. Furthermore, we extensively compare ABNet with existing works in person identification and demonstrate its effectiveness for activity-based biometrics across all five datasets. The code and dataset can be accessed at: \url{https://github.com/sacrcv/Activity-Biometrics/}


title: Bridging Textual and Tabular Worlds for Fact Verification: A Lightweight, Attention-Based Model

abstract: FEVEROUS is a benchmark and research initiative focused on fact extraction and verification tasks involving unstructured text and structured tabular data. In FEVEROUS, existing works often rely on extensive preprocessing and utilize rule-based transformations of data, leading to potential context loss or misleading encodings. This paper introduces a simple yet powerful model that nullifies the need for modality conversion, thereby preserving the original evidence's context. By leveraging pre-trained models on diverse text and tabular datasets and by incorporating a lightweight attention-based mechanism, our approach efficiently exploits latent connections between different data types, thereby yielding comprehensive and reliable verdict predictions. The model's modular structure adeptly manages multi-modal information, ensuring the integrity and authenticity of the original evidence are uncompromised. Comparative analyses reveal that our approach exhibits competitive performance, aligning itself closely with top-tier models on the FEVEROUS benchmark.


title: Safety, feasibility, and acceptability of a novel device to monitor ischaemic stroke patients

abstract: This study assessed the safety, feasibility, and acceptability of a novel device to monitor ischaemic stroke patients. The device captured electroencephalography (EEG) and electrocardiography (ECG) data to compute an ECG-based metric termed the Electrocardiography Brain Perfusion index (EBPi), which may function as a proxy for cerebral blood flow (CBF). Seventeen ischaemic stroke patients wore the device for nine hours and reported feedback at 1, 3, 6 and 9 hours regarding user experience, comfort, and satisfaction (acceptability). Safety was assessed as the number of adverse events reported. Feasibility was assessed as the percentage of uninterrupted EEG/ECG data recorded (data capture efficiency). No adverse events were reported, only minor incidences of discomfort. Overall device comfort (92.5% +/- 10.3%) and data capture efficiency (95.8% +/- 6.8%) were very high with relatively low variance. The device did not restrict participants from receiving clinical care and rarely (n=6) restricted participants from undertaking routine tasks. This study provides a promising evidence base for the deployment of the device in a clinical setting. If clinically validated, EBPi may be able to detect CBF changes to monitor early neurological deterioration and treatment outcomes, thus filling an important gap in current monitoring options.


title: Extracting Biomedical Entities from Noisy Audio Transcripts

abstract: Automatic Speech Recognition (ASR) technology is fundamental in transcribing spoken language into text, with considerable applications in the clinical realm, including streamlining medical transcription and integrating with Electronic Health Record (EHR) systems. Nevertheless, challenges persist, especially when transcriptions contain noise, leading to significant drops in performance when Natural Language Processing (NLP) models are applied. Named Entity Recognition (NER), an essential clinical task, is particularly affected by such noise, often termed the ASR-NLP gap. Prior works have primarily studied ASR's efficiency in clean recordings, leaving a research gap concerning the performance in noisy environments. This paper introduces a novel dataset, BioASR-NER, designed to bridge the ASR-NLP gap in the biomedical domain, focusing on extracting adverse drug reactions and mentions of entities from the Brief Test of Adult Cognition by Telephone (BTACT) exam. Our dataset offers a comprehensive collection of almost 2,000 clean and noisy recordings. In addressing the noise challenge, we present an innovative transcript-cleaning method using GPT4, investigating both zero-shot and few-shot methodologies. Our study further delves into an error analysis, shedding light on the types of errors in transcription software, corrections by GPT4, and the challenges GPT4 faces. This paper aims to foster improved understanding and potential solutions for the ASR-NLP gap, ultimately supporting enhanced healthcare documentation practices.


title: A Moreau Envelope Approach for LQR Meta-Policy Estimation

abstract: We study the problem of policy estimation for the Linear Quadratic Regulator (LQR) in discrete-time linear time-invariant uncertain dynamical systems. We propose a Moreau Envelope-based surrogate LQR cost, built from a finite set of realizations of the uncertain system, to define a meta-policy efficiently adjustable to new realizations. Moreover, we design an algorithm to find an approximate first-order stationary point of the meta-LQR cost function. Numerical results show that the proposed approach outperforms naive averaging of controllers on new realizations of the linear system. We also provide empirical evidence that our method has better sample complexity than Model-Agnostic Meta-Learning (MAML) approaches.


title: AutoMRISimQA: an automated system for daily quality control of a 3T MRI simulator

abstract: A software system named AutoMRISimQA was developed to monitor the daily performance of a wide-bore 3T scanner(MRI) which was designed and dedicated to radiotherapy simulation. The system can monitor the performance of the MRI simulator not only by using image quality indices such as signal-to-noise ratio (SNR), uniformity, ghosting and contrast but also performing a quick check of geometry accuracy as well as the external lasers quantitatively. It was implemented into the daily clinically workflow in 2013 and has been used for more than 10 years. It was also seamlessly integrated with QAtrack, allowing continuous monitoring of the consistency of the MRI simulator's performance.


title: Spatio-Temporal Correlation of Epileptic Seizures with The Electrocardiography Brain Perfusion Index

abstract: The Electrocardiography Brain Perfusion index (EBPi) is a novel electrocardiography (ECG)-based metric that may function as a proxy for cerebral blood flow (CBF). We investigated the spatio-temporal correlation between EBPi and epileptic seizure events. EBPi was computed retrospectively from clinical EEG and ECG data captured previously from 30 epilepsy patients during seizures. Significant EBPi changes were compared temporally with clinically defined ground-truth seizure onset and offset times. We also assessed the spatial correlation between EBPi metrics and clinically defined ground-truth seizure locations. A significant increase in EBPi was detected 10.5 s [-6, 53] (median [95% confidence interval (CI)]) after ground-truth seizure onset, and a significant decrease in EBPi was detected 5 s [-42, 74] (median [95% CI]) after ground-truth seizure offset. EBPi demonstrated a positive predictive value of 61.5% [33.3, 75] (median [95% CI]) and a sensitivity of 57.1% [38.5, 66.7] (median [95% CI]) for the detection of ground truth seizure locations. EBPi signals exhibited a temporal sensitivity to seizure events and in some cases were correlated spatially to the seizure location. Therefore, EBPi, which has been linked to CBF, appears to contain spatio-temporal information related to seizure activity and might have useful application in augmenting EEG data captured during seizures.


title: RoboDuet: A Framework Affording Mobile-Manipulation and Cross-Embodiment

abstract: Combining the mobility of legged robots with the manipulation skills of arms has the potential to significantly expand the operational range and enhance the capabilities of robotic systems in performing various mobile manipulation tasks. Existing approaches are confined to imprecise six degrees of freedom (DoF) manipulation and possess a limited arm workspace. In this paper, we propose a novel framework, RoboDuet, which employs two collaborative policies to realize locomotion and manipulation simultaneously, achieving whole-body control through interactions between each other. Surprisingly, going beyond the large-range pose tracking, we find that the two-policy framework may enable cross-embodiment deployment such as using different quadrupedal robots or other arms. Our experiments demonstrate that the policies trained through RoboDuet can accomplish stable gaits, agile 6D end-effector pose tracking, and zero-shot exchange of legged robots, and can be deployed in the real world to perform various mobile manipulation tasks. Our project page with demo videos is at https://locomanip-duet.github.io .


title: ChatGPT Rates Natural Language Explanation Quality Like Humans: But on Which Scales?

abstract: As AI becomes more integral in our lives, the need for transparency and responsibility grows. While natural language explanations (NLEs) are vital for clarifying the reasoning behind AI decisions, evaluating them through human judgments is complex and resource-intensive due to subjectivity and the need for fine-grained ratings. This study explores the alignment between ChatGPT and human assessments across multiple scales (i.e., binary, ternary, and 7-Likert scale). We sample 300 data instances from three NLE datasets and collect 900 human annotations for both informativeness and clarity scores as the text quality measurement. We further conduct paired comparison experiments under different ranges of subjectivity scores, where the baseline comes from 8,346 human annotations. Our results show that ChatGPT aligns better with humans in more coarse-grained scales. Also, paired comparisons and dynamic prompting (i.e., providing semantically similar examples in the prompt) improve the alignment. This research advances our understanding of large language models' capabilities to assess the text explanation quality in different configurations for responsible AI development.


title: CoDA: Instructive Chain-of-Domain Adaptation with Severity-Aware Visual Prompt Tuning

abstract: Unsupervised Domain Adaptation (UDA) aims to adapt models from labeled source domains to unlabeled target domains. When adapting to adverse scenes, existing UDA methods fail to perform well due to the lack of instructions, leading their models to overlook discrepancies within all adverse scenes. To tackle this, we propose CoDA which instructs models to distinguish, focus, and learn from these discrepancies at scene and image levels. Specifically, CoDA consists of a Chain-of-Domain (CoD) strategy and a Severity-Aware Visual Prompt Tuning (SAVPT) mechanism. CoD focuses on scene-level instructions to divide all adverse scenes into easy and hard scenes, guiding models to adapt from source to easy domains with easy scene images, and then to hard domains with hard scene images, thereby laying a solid foundation for whole adaptations. Building upon this foundation, we employ SAVPT to dive into more detailed image-level instructions to boost performance. SAVPT features a novel metric Severity that divides all adverse scene images into low-severity and high-severity images. Then Severity directs visual prompts and adapters, instructing models to concentrate on unified severity features instead of scene-specific features, without adding complexity to the model architecture. CoDA achieves SOTA performances on widely-used benchmarks under all adverse scenes. Notably, CoDA outperforms the existing ones by 4.6%, and 10.3% mIoU on the Foggy Driving, and Foggy Zurich benchmarks, respectively. Our code is available at https://github.com/Cuzyoung/CoDA


title: Formal Verification of the Empty Hexagon Number

abstract: A recent breakthrough in computer-assisted mathematics showed that every set of $30$ points in the plane in general position (i.e., without three on a common line) contains an empty convex hexagon, thus closing a line of research dating back to the 1930s. Through a combination of geometric insights and automated reasoning techniques, Heule and Scheucher constructed a CNF formula $\phi_n$, with $O(n^4)$ clauses, whose unsatisfiability implies that no set of $n$ points in general position can avoid an empty convex hexagon. An unsatisfiability proof for n = 30 was then found with a SAT solver using 17300 CPU hours of parallel computation, thus implying that the empty hexagon number h(6) is equal to 30. In this paper, we formalize and verify this result in the Lean theorem prover. Our formalization covers discrete computational geometry ideas and SAT encoding techniques that have been successfully applied to similar Erd\H{o}s-Szekeres-type problems. In particular, our framework provides tools to connect standard mathematical objects to propositional assignments, which represents a key step towards the formal verification of other SAT-based mathematical results. Overall, we hope that this work sets a new standard for verification when extensive computation is used for discrete geometry problems, and that it increases the trust the mathematical community has in computer-assisted proofs in this area.


title: Robust Containment Queries over Collections of Rational Parametric Curves via Generalized Winding Numbers

abstract: Point containment queries for regions bound by watertight geometric surfaces, i.e., closed and without self-intersections, can be evaluated straightforwardly with a number of well-studied algorithms. When this assumption on domain geometry is not met, such methods are either unusable, or prone to misclassifications that can lead to cascading errors in downstream applications. More robust point classification schemes based on generalized winding numbers have been proposed, as they are indifferent to these imperfections. However, existing algorithms are limited to point clouds and collections of linear elements. We extend this methodology to encompass more general curved shapes with an algorithm that evaluates the winding number scalar field over unstructured collections of rational parametric curves. In particular, we evaluate the winding number for each curve independently, making the derived containment query robust to how the curves are arranged. We ensure geometric fidelity in our queries by treating each curve as equivalent to an adaptively constructed polyline that provably has the same generalized winding number at the point of interest. Our algorithm is numerically stable for points that are arbitrarily close to the model, and explicitly treats points that are coincident with curves. We demonstrate the improvements in computational performance granted by this method over conventional techniques as well as the robustness induced by its application.


title: An Empirical Study of Training ID-Agnostic Multi-modal Sequential Recommenders

abstract: Sequential Recommendation (SR) aims to predict future user-item interactions based on historical interactions. While many SR approaches concentrate on user IDs and item IDs, the human perception of the world through multi-modal signals, like text and images, has inspired researchers to delve into constructing SR from multi-modal information without using IDs. However, the complexity of multi-modal learning manifests in diverse feature extractors, fusion methods, and pre-trained models. Consequently, designing a simple and universal \textbf{M}ulti-\textbf{M}odal \textbf{S}equential \textbf{R}ecommendation (\textbf{MMSR}) framework remains a formidable challenge. We systematically summarize the existing multi-modal related SR methods and distill the essence into four core components: visual encoder, text encoder, multimodal fusion module, and sequential architecture. Along these dimensions, we dissect the model designs, and answer the following sub-questions: First, we explore how to construct MMSR from scratch, ensuring its performance either on par with or exceeds existing SR methods without complex techniques. Second, we examine if MMSR can benefit from existing multi-modal pre-training paradigms. Third, we assess MMSR's capability in tackling common challenges like cold start and domain transferring. Our experiment results across four real-world recommendation scenarios demonstrate the great potential ID-agnostic multi-modal sequential recommendation. Our framework can be found at: https://github.com/MMSR23/MMSR.


title: AIDE: An Automatic Data Engine for Object Detection in Autonomous Driving

abstract: Autonomous vehicle (AV) systems rely on robust perception models as a cornerstone of safety assurance. However, objects encountered on the road exhibit a long-tailed distribution, with rare or unseen categories posing challenges to a deployed perception model. This necessitates an expensive process of continuously curating and annotating data with significant human effort. We propose to leverage recent advances in vision-language and large language models to design an Automatic Data Engine (AIDE) that automatically identifies issues, efficiently curates data, improves the model through auto-labeling, and verifies the model through generation of diverse scenarios. This process operates iteratively, allowing for continuous self-improvement of the model. We further establish a benchmark for open-world detection on AV datasets to comprehensively evaluate various learning paradigms, demonstrating our method's superior performance at a reduced cost.


title: Multi-Domain Recommendation to Attract Users via Domain Preference Modeling

abstract: Recently, web platforms have been operating various service domains simultaneously. Targeting a platform that operates multiple service domains, we introduce a new task, Multi-Domain Recommendation to Attract Users (MDRAU), which recommends items from multiple ``unseen'' domains with which each user has not interacted yet, by using knowledge from the user's ``seen'' domains. In this paper, we point out two challenges of MDRAU task. First, there are numerous possible combinations of mappings from seen to unseen domains because users have usually interacted with a different subset of service domains. Second, a user might have different preferences for each of the target unseen domains, which requires that recommendations reflect the user's preferences on domains as well as items. To tackle these challenges, we propose DRIP framework that models users' preferences at two levels (i.e., domain and item) and learns various seen-unseen domain mappings in a unified way with masked domain modeling. Our extensive experiments demonstrate the effectiveness of DRIP in MDRAU task and its ability to capture users' domain-level preferences.


title: Compensating for charge sharing by a deep-learning method: a preliminary experimental study

abstract: Photon counting detectors (PCDs) bring valuable advantages to diagnostic computed tomography (CT), including lower noise and higher resolution than energy integrating detectors. However, there are still several nonideal factors preventing PCDs from meeting people's expectations, for example, charge sharing and pile up. In this paper, we did some preliminary work on charge sharing and conducted an experimental study using an XCounter PCD to compare the effects of no anti-coincidence, anti-coincidence by hardware and charge sharing compensation by a deep learning method. In our results, a smaller bias and standard deviation are obtained from deep learning method than directly from no-anti-coincidence mode of the detector. Our network also outperforms the anti-coincidence mode of the detector in the low energy bin and has smaller standard deviation in the high energy bin. The results validate that a deep learning method is suitable to compensate for charge sharing.


title: Theoretical Analysis of Quality of Conventional Beamforming for Phased Microphone Arrays

abstract: A theoretical study is performed to analyze the directional response of different types of microphone array designs. 1-D (linear) and 2-D (planar) microphone array types are considered, and the delay and sum beamforming and conventional beamforming techniques are employed to localize the sound source. A non-dimensional parameter, G, is characterized to simplify and standardize the rejection performance of both 1-D and 2-D microphone arrays as a function of array geometry and sound source parameters. This parameter G is then used to determine an improved design of a 2-D microphone array for far-field sound localization. One such design, termed the Equi-area array is introduced and analyzed in detail. The design is shown to have an advantageous rejection performance compared to other conventionally used 2-D planar microphone arrays.


title: Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidance

abstract: Recent studies have demonstrated that diffusion models are capable of generating high-quality samples, but their quality heavily depends on sampling guidance techniques, such as classifier guidance (CG) and classifier-free guidance (CFG). These techniques are often not applicable in unconditional generation or in various downstream tasks such as image restoration. In this paper, we propose a novel sampling guidance, called Perturbed-Attention Guidance (PAG), which improves diffusion sample quality across both unconditional and conditional settings, achieving this without requiring additional training or the integration of external modules. PAG is designed to progressively enhance the structure of samples throughout the denoising process. It involves generating intermediate samples with degraded structure by substituting selected self-attention maps in diffusion U-Net with an identity matrix, by considering the self-attention mechanisms' ability to capture structural information, and guiding the denoising process away from these degraded samples. In both ADM and Stable Diffusion, PAG surprisingly improves sample quality in conditional and even unconditional scenarios. Moreover, PAG significantly improves the baseline performance in various downstream tasks where existing guidances such as CG or CFG cannot be fully utilized, including ControlNet with empty prompts and image restoration such as inpainting and deblurring.


title: Low-Latency Neural Speech Phase Prediction based on Parallel Estimation Architecture and Anti-Wrapping Losses for Speech Generation Tasks

abstract: This paper presents a novel neural speech phase prediction model which predicts wrapped phase spectra directly from amplitude spectra. The proposed model is a cascade of a residual convolutional network and a parallel estimation architecture. The parallel estimation architecture is a core module for direct wrapped phase prediction. This architecture consists of two parallel linear convolutional layers and a phase calculation formula, imitating the process of calculating the phase spectra from the real and imaginary parts of complex spectra and strictly restricting the predicted phase values to the principal value interval. To avoid the error expansion issue caused by phase wrapping, we design anti-wrapping training losses defined between the predicted wrapped phase spectra and natural ones by activating the instantaneous phase error, group delay error and instantaneous angular frequency error using an anti-wrapping function. We mathematically demonstrate that the anti-wrapping function should possess three properties, namely parity, periodicity and monotonicity. We also achieve low-latency streamable phase prediction by combining causal convolutions and knowledge distillation training strategies. For both analysis-synthesis and specific speech generation tasks, experimental results show that our proposed neural speech phase prediction model outperforms the iterative phase estimation algorithms and neural network-based phase prediction methods in terms of phase prediction precision, efficiency and robustness. Compared with HiFi-GAN-based waveform reconstruction method, our proposed model also shows outstanding efficiency advantages while ensuring the quality of synthesized speech. To the best of our knowledge, we are the first to directly predict speech phase spectra from amplitude spectra only via neural networks.


title: Exploring and Applying Audio-Based Sentiment Analysis in Music

abstract: Sentiment analysis is a continuously explored area of text processing that deals with the computational analysis of opinions, sentiments, and subjectivity of text. However, this idea is not limited to text and speech, in fact, it could be applied to other modalities. In reality, humans do not express themselves in text as deeply as they do in music. The ability of a computational model to interpret musical emotions is largely unexplored and could have implications and uses in therapy and musical queuing. In this paper, two individual tasks are addressed. This study seeks to (1) predict the emotion of a musical clip over time and (2) determine the next emotion value after the music in a time series to ensure seamless transitions. Utilizing data from the Emotions in Music Database, which contains clips of songs selected from the Free Music Archive annotated with levels of valence and arousal as reported on Russel's circumplex model of affect by multiple volunteers, models are trained for both tasks. Overall, the performance of these models reflected that they were able to perform the tasks they were designed for effectively and accurately.


title: Upper bound of higher-order Sobolev norms for Zkaharov system in one space dimension

abstract: We study the Cauchy problem for the Zakharov system in one space dimension with the Diriclet boundary conditions. We establish the global well-posedness and the growth of higher-order Sobolev norms of solutions to the Zakharov system by using the modified energy method.


title: Application-Driven Innovation in Machine Learning

abstract: As applications of machine learning proliferate, innovative algorithms inspired by specific real-world challenges have become increasingly important. Such work offers the potential for significant impact not merely in domains of application but also in machine learning itself. In this paper, we describe the paradigm of application-driven research in machine learning, contrasting it with the more standard paradigm of methods-driven research. We illustrate the benefits of application-driven machine learning and how this approach can productively synergize with methods-driven work. Despite these benefits, we find that reviewing, hiring, and teaching practices in machine learning often hold back application-driven innovation. We outline how these processes may be improved.


title: Characterizing Dependency Update Practice of NPM, PyPI and Cargo Packages

abstract: Keeping dependencies up-to-date prevents software supply chain attacks through outdated and vulnerable dependencies. Developers may use packages' dependency update practice as one of the selection criteria for choosing a package as a dependency. However, the lack of metrics characterizing packages' dependency update practice makes this assessment difficult. To measure the up-to-date characteristics of packages, we focus on the dependency management aspect and propose two update metrics: Time-Out-Of-Date (TOOD) and Post-Fix-Exposure-Time (PFET), to measure the updatedness of dependencies and updatedness of vulnerable dependencies, respectively. We design an algorithm to stabilize the dependency relationships in different time intervals and compute the proposed metrics for each package. Using our proposed metrics, we conduct a large-scale empirical study of update metrics with 2.9M packages, 66.8M package versions, and 26.8M unique package-dependency relations in NPM, PyPI, and Cargo, ranging from the year 2004 to 2023. We analyze the characteristics of the proposed metrics for capturing packages' dependency update practice in the three ecosystems. Given that the TOOD metric generates a greater volume of data than the PFET metric, we further explore the numerical relationship between these metrics to assess their potential as substitutes for vulnerability counts metrics. We find that PyPI packages update dependencies faster than NPM and Cargo. Conversely, Cargo packages update their vulnerable dependencies faster than NPM and PyPI. We also find that the general purpose update metric, TOOD, can be a proxy for the security-focused update metric, PFET.


title: Singular twisted links and singular twisted virtual braids

abstract: The concepts of twisted knot theory and singular knot theory inspire the introduction of singular twisted knot theory. This study showcases similar findings for singular twisted links, including the Alexander theorem and the Markov theorem derived from knot theory. Moreover, in this paper we define singular twisted virtual braids and their monoid structure. Additionally, we provide both a monoid and a reduced monoid presentation for singular twisted virtual braids.


title: Explainable Graph Neural Networks for Observation Impact Analysis in Atmospheric State Estimation

abstract: This paper investigates the impact of observations on atmospheric state estimation in weather forecasting systems using graph neural networks (GNNs) and explainability methods. We integrate observation and Numerical Weather Prediction (NWP) points into a meteorological graph, extracting $k$-hop subgraphs centered on NWP points. Self-supervised GNNs are employed to estimate the atmospheric state by aggregating data within these $k$-hop radii. The study applies gradient-based explainability methods to quantify the significance of different observations in the estimation process. Evaluated with data from 11 satellite and land-based observations, the results highlight the effectiveness of visualizing the importance of observation types, enhancing the understanding and optimization of observational data in weather forecasting.


title: ELLEN: Extremely Lightly Supervised Learning For Efficient Named Entity Recognition

abstract: In this work, we revisit the problem of semi-supervised named entity recognition (NER) focusing on extremely light supervision, consisting of a lexicon containing only 10 examples per class. We introduce ELLEN, a simple, fully modular, neuro-symbolic method that blends fine-tuned language models with linguistic rules. These rules include insights such as ''One Sense Per Discourse'', using a Masked Language Model as an unsupervised NER, leveraging part-of-speech tags to identify and eliminate unlabeled entities as false negatives, and other intuitions about classifier confidence scores in local and global context. ELLEN achieves very strong performance on the CoNLL-2003 dataset when using the minimal supervision from the lexicon above. It also outperforms most existing (and considerably more complex) semi-supervised NER methods under the same supervision settings commonly used in the literature (i.e., 5% of the training data). Further, we evaluate our CoNLL-2003 model in a zero-shot scenario on WNUT-17 where we find that it outperforms GPT-3.5 and achieves comparable performance to GPT-4. In a zero-shot setting, ELLEN also achieves over 75% of the performance of a strong, fully supervised model trained on gold data. Our code is available at: https://github.com/hriaz17/ELLEN.


title: A framework to identify supercritical and subcritical Turing bifurcations: Case study of a system sustaining cubic and quadratic autocatalysis

abstract: In this work, we focus on an autocatalytic reaction-diffusion model and carry out multiple scale weakly nonlinear analysis. A cubic and a quadratic autocatalytic reaction system is analysed. We develop a framework to identify the critical surfaces in parameter space across which the nature of the Turing bifurcation changes from supercritical to subcritical. These are verified by direct numerical simulations of the system. Using weakly nonlinear analysis, we derive equations up to the fifth order that governs the amplitude of the spatial patterns. The limit point of the bifurcating solution is captured accurately by extending the analysis to the fifth order for the case of subcritical bifurcation. The numerical solutions are in good agreement with the predictions of the weakly nonlinear analysis for supercritical bifurcations. We show that when multiple steady states arise Turing patterns can coexist with another spatially uniform steady states. Furthermore, we show that our framework can be extended to get different patterns like squares and hexagons in a two-dimensional domain. We show that the shape of Turing patterns is influenced by the domain size. This shows that the geometry can influence the kind of patterns formed in natural systems. This study will aid the experimentalist identify operating conditions where Turing patterns can be obtained.


title: Decoupled Pseudo-labeling for Semi-Supervised Monocular 3D Object Detection

abstract: We delve into pseudo-labeling for semi-supervised monocular 3D object detection (SSM3OD) and discover two primary issues: a misalignment between the prediction quality of 3D and 2D attributes and the tendency of depth supervision derived from pseudo-labels to be noisy, leading to significant optimization conflicts with other reliable forms of supervision. We introduce a novel decoupled pseudo-labeling (DPL) approach for SSM3OD. Our approach features a Decoupled Pseudo-label Generation (DPG) module, designed to efficiently generate pseudo-labels by separately processing 2D and 3D attributes. This module incorporates a unique homography-based method for identifying dependable pseudo-labels in BEV space, specifically for 3D attributes. Additionally, we present a DepthGradient Projection (DGP) module to mitigate optimization conflicts caused by noisy depth supervision of pseudo-labels, effectively decoupling the depth gradient and removing conflicting gradients. This dual decoupling strategy-at both the pseudo-label generation and gradient levels-significantly improves the utilization of pseudo-labels in SSM3OD. Our comprehensive experiments on the KITTI benchmark demonstrate the superiority of our method over existing approaches.


title: Incoherent GRAPE (inGRAPE) for optimization of quantum systems with environmentally assisted control

abstract: In this work, we review several results on development and application of incoherent version of GRAPE (Gradient Ascent Pulse Engineering) approach, inGRAPE, to optimization for open quantum systems driven by both coherent and incoherent controls. In the incoherent control approach, the environment serves as a control together with coherent field, and decoherence rates become generally time-dependent. For a qubit, explicit analytic expressions for evolution of the density matrix were obtained by solving a cubic equation via Cardano method. We discuss applications of incoherent GRAPE method to high fidelity gate generation for open one- and two-qubit systems and surprising properties of the underlying control landscapes, forming two groups - smooth single peak landscapes for Hadamard, C-NOT and C-Z gates, and more complicated with two peaks for T (or $\pi/8$) gate. For a qutrit, a formulation of the environment-assisted incoherent control with time-dependent decoherence rates is provided.


title: Quantum-Enhanced Simulation-Based Optimization for Newsvendor Problems

abstract: Simulation-based optimization is a widely used method to solve stochastic optimization problems. This method aims to identify an optimal solution by maximizing the expected value of the objective function. However, due to its computational complexity, the function cannot be accurately evaluated directly, hence it is estimated through simulation. Exploiting the enhanced efficiency of Quantum Amplitude Estimation (QAE) compared to classical Monte Carlo simulation, it frequently outpaces classical simulation-based optimization, resulting in notable performance enhancements in various scenarios. In this work, we make use of a quantum-enhanced algorithm for simulation-based optimization and apply it to solve a variant of the classical Newsvendor problem which is known to be NP-hard. Such problems provide the building block for supply chain management, particularly in inventory management and procurement optimization under risks and uncertainty


title: SSF3D: Strict Semi-Supervised 3D Object Detection with Switching Filter

abstract: SSF3D modified the semi-supervised 3D object detection (SS3DOD) framework, which designed specifically for point cloud data. Leveraging the characteristics of non-coincidence and weak correlation of target objects in point cloud, we adopt a strategy of retaining only the truth-determining pseudo labels and trimming the other fuzzy labels with points, instead of pursuing a balance between the quantity and quality of pseudo labels. Besides, we notice that changing the filter will make the model meet different distributed targets, which is beneficial to break the training bottleneck. Two mechanism are introduced to achieve above ideas: strict threshold and filter switching. The experiments are conducted to analyze the effectiveness of above approaches and their impact on the overall performance of the system. Evaluating on the KITTI dataset, SSF3D exhibits superior performance compared to the current state-of-the-art methods. The code will be released here.


title: Reverse Kron reduction of Multi-phase Radial Network

abstract: We consider the problem of identifying the admittance matrix of a three-phase radial network from voltage and current measurements at a subset of nodes. These measurements are used to estimate a virtual network represented by the Kron reduction (Schur complement) of the full admittance matrix. We focus on recovering exactly the full admittance matrix from its Kron reduction, i.e., computing the inverse of Schur complement. The key idea is to decompose Kron reduction into a sequence of iterations that maintains an invariance structure, and exploit this structure to reverse each step of the iterative Kron reduction.


title: Natural-artificial hybrid swarm: Cyborg-insect group navigation in unknown obstructed soft terrain

abstract: Navigating multi-robot systems in complex terrains has always been a challenging task. This is due to the inherent limitations of traditional robots in collision avoidance, adaptation to unknown environments, and sustained energy efficiency. In order to overcome these limitations, this research proposes a solution by integrating living insects with miniature electronic controllers to enable robotic-like programmable control, and proposing a novel control algorithm for swarming. Although these creatures, called cyborg insects, have the ability to instinctively avoid collisions with neighbors and obstacles while adapting to complex terrains, there is a lack of literature on the control of multi-cyborg systems. This research gap is due to the difficulty in coordinating the movements of a cyborg system under the presence of insects' inherent individual variability in their reactions to control input. In response to this issue, we propose a novel swarm navigation algorithm addressing these challenges. The effectiveness of the algorithm is demonstrated through an experimental validation in which a cyborg swarm was successfully navigated through an unknown sandy field with obstacles and hills. This research contributes to the domain of swarm robotics and showcases the potential of integrating biological organisms with robotics and control theory to create more intelligent autonomous systems with real-world applications.


title: Axial Anomalies of Maximally Supersymmetric Tensor Theories

abstract: We revisit anomalies of $(4,0)$ and $(3,1)$ maximally supersymmetric tensor theories in $d=6$. A $(4,0)$ on-shell tensor multiplet descends to that of the $d=5$ maximal supergravity upon a dimensional reduction, hypothesized to offer a strong-coupled UV completion of the latter in the same sense of $(2,0)$ theories as the UV completion of $d=5$ $\mathcal{N}=2$ pure Yang-Mills. The gravitational anomalies, found to be nonvanishing, had been computed, although its relevance in the absence of the $d=6$ metric is not obvious. We perform a comprehensive anomaly computation for $(4,0)$ and $(3,1)$ tensor supermultiplets, respectively, for $Sp(4)$ and $Sp(3)\times Sp(1)$ $R$-symmetry anomalies and the mixed $R$-gravitational anomaly thereof, and find that anomalies involving $R$-symmetries cancel out identically. We close with questions on how to address the anomaly in this class of theories with no general covariance.


title: IQMDose3D: a software tool for reconstructing the dose in patient using patient planning CT images and the signals measured by IQM detector

abstract: The integral quality monitor (IQM) system compares the signal measured with a large volume chamber mounted to the linear accelerator's head to the signal calculated using the patient DICOM RT plan for patient-specific quality assurance (PSQA). A method was developed to reconstruct the dose in patients using the signal measured by IQM chamber and patient planning CT images. A software tool named IQMDose3D was implemented to automate this procedure and integrated into the IQM-based PSQA workflow. IQMDose3D enables the physicists to evaluate PSQA by focusing on the clinical perspective by comparing the delivered plan to the approved clinical plan in terms of the clinical goals, dose-volume histogram (DVH) in addition to the three-dimensional (3D) gamma map and gamma pass rate.


title: An Open-source End-to-End Logic Optimization Framework for Large-scale Boolean Network with Reinforcement Learning

abstract: We propose an open-source end-to-end logic optimization framework for large-scale boolean network with reinforcement learning.


title: Handling multivariable missing data in causal mediation analysis

abstract: Mediation analysis is commonly used in epidemiological research, but guidance is lacking on how multivariable missing data should be dealt with in these analyses. Multiple imputation (MI) is a widely used approach, but questions remain regarding impact of missingness mechanism, how to ensure imputation model compatibility and approaches to variance estimation. To address these gaps, we conducted a simulation study based on the Victorian Adolescent Health Cohort Study. We considered six missingness mechanisms, involving varying assumptions regarding the influence of outcome and/or mediator on missingness in key variables. We compared the performance of complete-case analysis, seven MI approaches, differing in how the imputation model was tailored, and a "substantive model compatible" MI approach. We evaluated both the MI-Boot (MI, then bootstrap) and Boot-MI (bootstrap, then MI) approaches to variance estimation. Results showed that when the mediator and/or outcome influenced their own missingness, there was large bias in effect estimates, while for other mechanisms appropriate MI approaches yielded approximately unbiased estimates. Beyond incorporating all analysis variables in the imputation model, how MI was tailored for compatibility with mediation analysis did not greatly impact point estimation bias. BootMI returned variance estimates with smaller bias than MIBoot, especially in the presence of incompatibility.


title: On Abhyankar-Sathaye Conjecture for a family of linear hypersurfaces in $\A_{k}^4$

abstract: Let $k$ be a field. In this paper we study the Abhyankar-Sathaye Epimorphism Conjecture for certain hyperplanes in $\A_k^4$ defined by a polynomial of the form $a(X)Y-F(X,Z,T)$. When $k=\bC$, Kaliman, V\'{e}n\'{e}reau and Zaidenberg have proved that such hyperplanes are rectifiable in $\A^4_{\bC}$. We extend their result over any field of characteristic zero and when $k$ is a field of arbitrary characteristic we prove the Abhyankar-Sathaye Conjecture for such hyperplanes under some conditions on the roots of $a(X)$.


title: Generic dimensional and dynamical properties of invariant measures of full-shift systems over countable alphabets

abstract: In this work, we are interested in characterizing typical (generic) dimensional properties of invariant measures associated with the full-shift system, $T$, in a product space whose alphabet is a countable set. More specifically, we show that the set of invariant measures with infinite packing dimension equal to infinity is a dense $G_\delta$ subset of $\mathcal{M}(T)$, the space of $T$-invariant measures endowed with the weak topology, where the alphabet $M$ is a countable Polish metric space. We also show that the set of invariant measures with upper $q$-generalized fractal dimension (with $q>1$) equal to infinity is a dense $G_\delta$ subset of $\mathcal{M}(T)$, where the alphabet $M$ is a countable compact metric space. This improves the results obtained by Carvalho and Condori in \cite{AS} and \cite{AS2}, respectively. Furthermore, we discuss the dynamical consequences of such results, regarding the upper recurrence rates and upper quantitative waiting time indicator for typical orbits, and how the fractal dimensions of invariant measures and such dynamical quantities behave under an $\alpha$-H\"older conjugation.


title: Compressed sensing enhanced by quantum approximate optimization algorithm

abstract: We present a framework to deal with a range of large scale compressive sensing problems using a quantum subroutine. We apply a quantum approximate optimization algorithm (QAOA) to support detection in a sparse signal reconstruction algorithm: matching pursuit. The constrained optimization required in this algorithm is difficult to handle when the size of the problem is large and constraints are given by unstructured patterns. Our framework utilizes specially designed structured constraints that are easy to manipulate and reduce the optimization problem to the solution of an Ising model which can be found using Ising solvers. In this research, we test the performance of QAOA for this purpose on a simulator of quantum computer. We observe that our method can outperform reference classical methods. Our results explore a promising path of applying quantum computers in the compressive sensing field.


title: A Survey on Resource Management in Joint Communication and Computing-Embedded SAGIN

abstract: The advent of the 6G era aims for ubiquitous connectivity, with the integration of non-terrestrial networks (NTN) offering extensive coverage and enhanced capacity. As manufacturing advances and user demands evolve, space-air-ground integrated networks (SAGIN) with computational capabilities emerge as a viable solution for services requiring low latency and high computational power. Resource management within joint communication and computing-embedded SAGIN (JCC-SAGIN) presents greater complexity than traditional terrestrial networks. This complexity arises from the spatiotemporal dynamics of network topology and service demand, the interdependency of large-scale resource variables, and intricate tradeoffs among various performance metrics. Thus, a thorough examination of resource management strategies in JCC-SAGIN is crucial, emphasizing the role of non-terrestrial platforms with processing capabilities in 6G. This paper begins by reviewing the architecture, enabling technologies, and applications in JCC-SAGIN. Then, we offer a detailed overview of resource management modeling and optimization methods, encompassing both traditional optimization approaches and learning-based intelligent decision-making frameworks. Finally, we outline the prospective research directions in JCC-SAGIN.


title: New and old Saito-Kurokawa lifts classically via $L^2$ norms and bounds on their supnorms: level aspect

abstract: In the first half of the paper, we lay down a classical approach to the study of Saito-Kurokawa (SK) lifts of (Hecke congruence) square-free level, including the allied new-oldform theory. Our treatment of this relies on a novel idea of computing ranks of certain matrices whose entries are $L^2$-norms of eigenforms. For computing the $L^2$ norms we work with the Hecke algebra of $\mathrm{GSp}(2)$. In the second half, we formulate precise conjectures on the $L^\infty$ size of the space of SK lifts of square-free level, measured by the supremum of its Bergman kernel, and prove bounds towards them using the results from the first half. Here we rely on counting points on lattices, and on the geometric side of the Bergman kernels of spaces of Jacobi forms underlying the SK lifts. Along the way, we prove a non-trivial bound for the sup-norm of a Jacobi newform of square-free level and also discuss about their size on average.


title: Infrastructure-less Localization from Indoor Environmental Sounds Based on Spectral Decomposition and Spatial Likelihood Model

abstract: Human and/or asset tracking using an attached sensor units helps understand their activities. Most common indoor localization methods for human tracking technologies require expensive infrastructures, deployment and maintenance. To overcome this problem, environmental sounds have been used for infrastructure-free localization. While they achieve room-level classification, they suffer from two problems: low signal-to-noise-ratio (SNR) condition and non-uniqueness of sound over the coverage area. A microphone localization method was proposed using supervised spectral decomposition and spatial likelihood to solve these problems. The proposed method was evaluated with actual recordings in an experimental room with a size of 12 x 30 m. The results showed that the proposed method with supervised NMF was robust under low-SNR condition compared to a simple feature (mel frequency cepstrum coefficient: MFCC). Additionally, the proposed method could be easily integrated with prior distribution, which is available from other Bayesian localizations. The proposed method can be used to evaluate the spatial likelihood from environmental sounds.


title: Vortex nucleations in spinor Bose condensates under localized synthetic magnetic fields

abstract: Gauge fields are ubiquitous in modern quantum physics. In superfluids, quantized vortices can be induced by gauge fields. Here we demonstrate the first experimental observation of vortex nucleations in spinor Bose-Einstein Condensates under radially-localized synthetic magnetic fields. The associated gauge potentials $\vec{A}$ are azimuthal and created by light-induced spin-orbital-angular-momentum coupling, generating circulating azimuthal velocity fields $\propto \vec{p}-\vec{A}$ even when the canonical momentum $\vec{p}= 0$. A sufficiently large azimuthal velocity peaked near the condensate center results in a dynamically unstable localized excitation that initiates vortex nucleations. This excitation appears as a spontaneously-formed vortex-antivortex pair near the cloud center. Following the initially developed instability, the dynamics is governed by the asymmetry and dissipation, where the atomic orbital angular momentum evolves and can reach the value of the ground state. Our system exhibits dynamical and Landau instabilities and agrees reasonably with time-dependent Gross-Pitaevskii simulations.


title: Generalization Error Analysis for Sparse Mixture-of-Experts: A Preliminary Study

abstract: Mixture-of-Experts (MoE) represents an ensemble methodology that amalgamates predictions from several specialized sub-models (referred to as experts). This fusion is accomplished through a router mechanism, dynamically assigning weights to each expert's contribution based on the input data. Conventional MoE mechanisms select all available experts, incurring substantial computational costs. In contrast, Sparse Mixture-of-Experts (Sparse MoE) selectively engages only a limited number, or even just one expert, significantly reducing computation overhead while empirically preserving, and sometimes even enhancing, performance. Despite its wide-ranging applications and these advantageous characteristics, MoE's theoretical underpinnings have remained elusive. In this paper, we embark on an exploration of Sparse MoE's generalization error concerning various critical factors. Specifically, we investigate the impact of the number of data samples, the total number of experts, the sparsity in expert selection, the complexity of the routing mechanism, and the complexity of individual experts. Our analysis sheds light on \textit{how \textbf{sparsity} contributes to the MoE's generalization}, offering insights from the perspective of classical learning theory.


title: The recessionary pressures of generative AI: A threat to wellbeing

abstract: Generative Artificial Intelligence (AI) stands as a transformative force that presents a paradox; it offers unprecedented opportunities for productivity growth while potentially posing significant threats to economic stability and societal wellbeing. Many consider generative AI as akin to previous technological advancements, using historical precedent to argue that fears of widespread job displacement are unfounded, while others contend that generative AI`s unique capacity to undertake non-routine cognitive tasks sets it apart from other forms of automation capital and presents a threat to the quality and availability of work that underpin stable societies. This paper explores the conditions under which both may be true. We posit the existence of an AI-capital-to-labour ratio threshold beyond which a self-reinforcing cycle of recessionary pressures could be triggered, exacerbating social disparities, reducing social cohesion, heightening tensions, and requiring sustained government intervention to maintain stability. To prevent this, the paper underscores the urgent need for proactive policy responses, making recommendations to reduce these risks through robust regulatory frameworks and a new social contract characterised by progressive social and economic policies. This approach aims to ensure a sustainable, inclusive, and resilient economic future where human contribution to the economy is retained and integrated with generative AI to enhance the Mental Wealth of nations.


title: A Full Resolution of the 450 {\mu}m Extragalactic Background Light

abstract: The extragalactic background light (EBL) is the cumulative radiation outside the Milky Way. The determination of its corresponding primary emitting sources as well as its total energy level across the entire electromagnetic spectrum has profound implications for both cosmology and galaxy formation. However, the detailed origin of the EBL at far-infrared wavelengths, particularly those close to the peak of the cosmic infrared background, remains unclear. Here we report the results of our ongoing SCUBA-2 450 $\mu$m survey of 10 massive galaxy cluster fields. By exploiting the strong gravitational lensing offered by these clusters, we obtain significant counts down to an unprecedented depth of $\sim$0.1 mJy at this wavelength, about ten times deeper than that reached by any other previous survey. The cumulative energy density based on the counts is 138.1$^{+23.9}_{-19.3}$ Jy degree$^{-2}$, or 0.45$^{+0.08}_{-0.06}$ MJy sr$^{-1}$. Comparing our measurements to those made by the COBE and Planck satellites, we find that at this flux density level, the 450 $\mu$m EBL is entirely resolved by our SCUBA-2 observations. Thus, we find for the first time that discrete sources produce fully to the 450 $\mu$m EBL, and that about half of it comes from sources with sub-mJy flux densities. Our deep number counts provide strong constraints on galaxy formation models.


title: Transcribing Bengali Text with Regional Dialects to IPA using District Guided Tokens

abstract: Accurate transcription of Bengali text to the International Phonetic Alphabet (IPA) is a challenging task due to the complex phonology of the language and context-dependent sound changes. This challenge is even more for regional Bengali dialects due to unavailability of standardized spelling conventions for these dialects, presence of local and foreign words popular in those regions and phonological diversity across different regions. This paper presents an approach to this sequence-to-sequence problem by introducing the District Guided Tokens (DGT) technique on a new dataset spanning six districts of Bangladesh. The key idea is to provide the model with explicit information about the regional dialect or "district" of the input text before generating the IPA transcription. This is achieved by prepending a district token to the input sequence, effectively guiding the model to understand the unique phonetic patterns associated with each district. The DGT technique is applied to fine-tune several transformer-based models, on this new dataset. Experimental results demonstrate the effectiveness of DGT, with the ByT5 model achieving superior performance over word-based models like mT5, BanglaT5, and umT5. This is attributed to ByT5's ability to handle a high percentage of out-of-vocabulary words in the test set. The proposed approach highlights the importance of incorporating regional dialect information into ubiquitous natural language processing systems for languages with diverse phonological variations. The following work was a result of the "Bhashamul" challenge, which is dedicated to solving the problem of Bengali text with regional dialects to IPA transcription https://www.kaggle.com/competitions/regipa/. The training and inference notebooks are available through the competition link.


title: Non-coplanar spin structure in a metallic thin film of triangular lattice antiferromagnet CrSe

abstract: An antiferromagnetic metal with two-dimensional triangular network offers a unique playground of intriguing magneto-transport properties and functionalities stemming from interplay between conducting electrons and intricate magnetic phases. A NiAs-type CrSe is one of the candidates owing to alternate stackings of Cr and Se triangular atomic networks in its crystal structure. While fabrication of CrSe thin films is indispensable to develop functional devices, studies on its thin-film properties have been limited to date due to the lack of metallic samples. Here, we report on realization of metallic conductivities of CrSe thin films, which allows to investigate their intrinsic magneto-transport properties. The metallic sample exhibits co-occurrence of a weak ferromagnetism with perpendicular magnetic anisotropy and the antiferromagnetic behavior, indicating the presence of non-coplanar spin structures. In addition, control of polarity and tilting angle of the non-coplanar spin structure is accomplished by a sign of cooling magnetic fields. The observed non-coplanar spin structure, which can be a source of emergent magnetic field acting on the conducting electrons, highlights a high potential of the triangular lattice antiferromagnet and provide unique platform for functional thin-film devices composed of NiAs-type derivative Cr chalcogenides and pnictides.


title: Neural Clustering based Visual Representation Learning

abstract: We investigate a fundamental aspect of machine vision: the measurement of features, by revisiting clustering, one of the most classic approaches in machine learning and data analysis. Existing visual feature extractors, including ConvNets, ViTs, and MLPs, represent an image as rectangular regions. Though prevalent, such a grid-style paradigm is built upon engineering practice and lacks explicit modeling of data distribution. In this work, we propose feature extraction with clustering (FEC), a conceptually elegant yet surprisingly ad-hoc interpretable neural clustering framework, which views feature extraction as a process of selecting representatives from data and thus automatically captures the underlying data distribution. Given an image, FEC alternates between grouping pixels into individual clusters to abstract representatives and updating the deep features of pixels with current representatives. Such an iterative working mechanism is implemented in the form of several neural layers and the final representatives can be used for downstream tasks. The cluster assignments across layers, which can be viewed and inspected by humans, make the forward process of FEC fully transparent and empower it with promising ad-hoc interpretability. Extensive experiments on various visual recognition models and tasks verify the effectiveness, generality, and interpretability of FEC. We expect this work will provoke a rethink of the current de facto grid-style paradigm.