title: Modeling of Subwavelength Gratings: Near-Field Behavior

abstract: Subwavelength gratings, with period shorter than the incident wavelength, have garnered significant attention in the fields of photonics, optoelectronics, and image sensor technology. In this research, we delve into the scattering characteristics of these gratings by employing the 2-dimensional point dipole approximation. Additionally, we propose a version of perturbation theory that relies on Fourier decomposition to obtain analytical expressions for the near-field behavior. We validate our models using numerical techniques such as boundary and finite element analysis. Notably, we explore how parameters like the grating period and slit width affect field enhancements. We demonstrate that our models produce qualitatively accurate results even for narrow slits.


title: ChatGPT-guided Semantics for Zero-shot Learning

abstract: Zero-shot learning (ZSL) aims to classify objects that are not observed or seen during training. It relies on class semantic description to transfer knowledge from the seen classes to the unseen classes. Existing methods of obtaining class semantics include manual attributes or automatic word vectors from language models (like word2vec). We know attribute annotation is costly, whereas automatic word-vectors are relatively noisy. To address this problem, we explore how ChatGPT, a large language model, can enhance class semantics for ZSL tasks. ChatGPT can be a helpful source to obtain text descriptions for each class containing related attributes and semantics. We use the word2vec model to get a word vector using the texts from ChatGPT. Then, we enrich word vectors by combining the word embeddings from class names and descriptions generated by ChatGPT. More specifically, we leverage ChatGPT to provide extra supervision for the class description, eventually benefiting ZSL models. We evaluate our approach on various 2D image (CUB and AwA) and 3D point cloud (ModelNet10, ModelNet40, and ScanObjectNN) datasets and show that it improves ZSL performance. Our work contributes to the ZSL literature by applying ChatGPT for class semantics enhancement and proposing a novel word vector fusion method.


title: A Set-Based Approach for Robust Control Co-Design

abstract: Control Co-Design (CCD) considers the coupled effects of both the plant and control parameters to optimize a system's closed-loop transient performance during the design stage. This paper presents a new method for CCD with guarantees on robustness to nondeterministic disturbances for all initial conditions within a specified region of operation. This is accomplished by calculating the reachable sets of a candidate closed-loop system directly within the optimization problem. Using this approach, the plant and control parameters are simultaneously chosen to shape these reachable sets to be robustly positive invariant and thus safe for all time. Compared to conventional approaches that perform the optimization for a single initial condition and an a priori chosen sequence of disturbances, the proposed set-based method avoids sensitivity to variations in the assumed design scenario. As a representative example, the proposed method is applied to an active suspension system.


title: Flymation: Interactive Animation for Flying Robots

abstract: Trajectory visualization and animation play critical roles in robotics research. However, existing data visualization and animation tools often lack flexibility, scalability, and versatility, resulting in limited capability to fully explore and analyze flight data. To address this limitation, we introduce Flymation, a new flight trajectory visualization and animation tool. Built on the Unity3D engine, Flymation is an intuitive and interactive tool that allows users to visualize and analyze flight data in real time. Users can import data from various sources, including flight simulators and real-world data, and create customized visualizations with high-quality rendering. With Flymation, users can choose between trajectory snapshot and animation; both provide valuable insights into the behavior of the underlying autonomous system. Flymation represents an exciting step toward visualizing and interacting with large-scale data in robotics research.


title: How different is the magnetic field at the core-crust interface from that at the neutron star surface? -- the range allowed in magnetoelastic equilibrium

abstract: This study was focused on the investigation of a magnetic field penetrating from the core of a neutron star to its surface. The range of possible field configurations in the intermediate solid crust is less limited owing to the elastic force acting on the force balance. When the Lorentz force is excessively strong, the magnetoelastic equilibrium does not hold, and thus, the magnetic field becomes constrained. By numerically solving for the magnetoelastic equilibrium in a thin crust, the range of the magnetic field at the core-crust interface was determined, while assuming the exterior to be fixed as a dipole in vacuum. The results revealed that the toroidal component should be smaller than the poloidal component at the core-crust interface for the surface dipole, $B_{0} > 2.1 \times 10^{14}$G. Consequently, a strong toroidal field, for example, $B \sim 10^{16}$G, as suggested by free precession of magnetars should be confined to a deep interior core and should be reduced to $B \sim 10^{14}$G at the bottom of the crust. The findings of this study provide insights into the interior field structure of magnetars. Further investigations on more complicated geometries with higher multipoles and exterior magnetosphere are necessary.


title: Extreme local statistics in random graphs: maximum tree extension counts

abstract: We consider maximum rooted tree extension counts in random graphs, i.e., we consider M_n = \max_v X_v where X_v counts the number of copies of a given tree in G_{n,p} rooted at vertex v. We determine the asymptotics of M_n when the random graph is not too sparse, specifically when the edge probability p=p(n) satisfies p(1-p)n \gg \log n. The problem is more difficult in the sparser regime 1 \ll pn \ll \log n, where we determine the asymptotics of M_n for specific classes of trees. Interestingly, here our large deviation type optimization arguments reveal that the behavior of M_n changes as we vary p=p(n), due to different mechanisms that can make the maximum large.


title: Note on down-set thresholds

abstract: Gunby-He-Narayanan showed that the logarithmic gap predictions of Kahn-Kalai and Talagrand (proved by Park-Pham and Frankston-Kahn-Narayanan-Park) about thresholds of up-sets do not apply to down-sets. In particular, for the down-set of triangle-free graphs, they showed that there is a polynomial gap between the threshold and the factional expectation threshold. In this short note we give a simpler proof of this result, and extend the polynomial threshold gap to down-sets of F-free graphs.


title: High Efficiency Polymer based Direct Multi-jet Impingement Cooling Solution for High Power Devices

abstract: Liquid jet impingement cooling is an efficient cooling technique where the liquid coolant is directly ejected from nozzles on the chip backside resulting in a high cooling efficiency due to the absence of the TIM and the lateral temperature gradient. In literature, several Si-fabrication based impingement coolers with nozzle diameters of a few distributed returns or combination of micro-channels and impingement nozzles. The drawback of this Si processing of the cooler is the high fabrication cost. Other fabrication methods for nozzle diameters for ceramic and metal. Low cost fabrication methods, including injection molding and 3D printing have been introduced for much larger nozzle diameters (mm range) with larger cooler dimensions. These dimensions and processes are however not compatible with the chip packaging process flow. This PhD focuses on the modeling, design, fabrication and characterization of a micro-scale liquid impingement cooler using advanced, yet cost efficient, fabrication techniques. The main objectives are: (a) development of a modeling methodology to optimize the cooler geometry; (b) exploring low cost fabrication methods for the package level impingement jet cooler; (c) experimental thermal and hydraulic characterization and analysis of the fabricated coolers; (d) applying the direct impingement jet cooling solutions to different applications.


title: Hetero$^2$Net: Heterophily-aware Representation Learning on Heterogenerous Graphs

abstract: Real-world graphs are typically complex, exhibiting heterogeneity in the global structure, as well as strong heterophily within local neighborhoods. While a growing body of literature has revealed the limitations of common graph neural networks (GNNs) in handling homogeneous graphs with heterophily, little work has been conducted on investigating the heterophily properties in the context of heterogeneous graphs. To bridge this research gap, we identify the heterophily in heterogeneous graphs using metapaths and propose two practical metrics to quantitatively describe the levels of heterophily. Through in-depth investigations on several real-world heterogeneous graphs exhibiting varying levels of heterophily, we have observed that heterogeneous graph neural networks (HGNNs), which inherit many mechanisms from GNNs designed for homogeneous graphs, fail to generalize to heterogeneous graphs with heterophily or low level of homophily. To address the challenge, we present Hetero$^2$Net, a heterophily-aware HGNN that incorporates both masked metapath prediction and masked label prediction tasks to effectively and flexibly handle both homophilic and heterophilic heterogeneous graphs. We evaluate the performance of Hetero$^2$Net on five real-world heterogeneous graph benchmarks with varying levels of heterophily. The results demonstrate that Hetero$^2$Net outperforms strong baselines in the semi-supervised node classification task, providing valuable insights into effectively handling more complex heterogeneous graphs.


title: Forward Kinematics of Object Transporting by a Multi-Robot System with a Deformable Sheet

abstract: We present object handling and transporting by a multi-robot team with a deformable sheet as a carrier. Due to the deformability of the sheet and the high dimension of the whole system, it is challenging to clearly describe all the possible positions of the object on the sheet for a given formation of the multi-robot system. A complete forward kinematics (FK) method is proposed for object handling by an $N$-mobile robot team with a deformable sheet. Based on the virtual variable cables model (VVCM), a constrained quadratic problem (CQP) is formulated by combining the geometric constraints and minimum potential energy conditions of the system. Analytical solutions to the CQP are presented and then further verified with the force closure condition. We present an FK algorithm based on the FK method to obtain all possible solutions with the given initial sheet shape and the robot team formation. We demonstrate the effectiveness, completeness, and efficiency of the FK algorithm with experimental results and case study examples.


title: Non-empirical shape dynamics of heavy nuclei with multi-task deep learning

abstract: A microscopic description of nuclear fission represents one of the most challenging problems in nuclear theory. While phenomenological coordinates, such as multipole moments, have often been employed to describe fission, it is not obvious whether these parameters fully reflect the shape dynamics of interest. We here propose a novel method to extract collective coordinates, which are free from phenomenology, based on multi-task deep learning in conjunction with a density functional theory (DFT). To this end, we first introduce randomly generated external fields to a Skyrme-EDF and construct a set of nuclear number densities and binding energies for deformed states of ${}^{236}$U around the ground state. By training a neural network on such dataset with a combination of an autoencoder and supervised learning, we successfully identify a two-dimensional latent variables that accurately reproduce both the energies and the densities of the original Skyrme-EDF calculations, within a mean absolute error of 113 keV for the energies. In contrast, when multipole moments are used as latent variables for training in constructing the decoders, we find that the training data for the binding energies are reproduced only within 2 MeV. This implies that conventional multipole moments do not provide fully adequate variables for a shape dynamics of heavy nuclei.


title: SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents

abstract: Humans are social beings; we pursue social goals in our daily interactions, which is a crucial aspect of social intelligence. Yet, AI systems' abilities in this realm remain elusive. We present SOTOPIA, an open-ended environment to simulate complex social interactions between artificial agents and evaluate their social intelligence. In our environment, agents role-play and interact under a wide variety of scenarios; they coordinate, collaborate, exchange, and compete with each other to achieve complex social goals. We simulate the role-play interaction between LLM-based agents and humans within this task space and evaluate their performance with a holistic evaluation framework called SOTOPIA-Eval. With SOTOPIA, we find significant differences between these models in terms of their social intelligence, and we identify a subset of SOTOPIA scenarios, SOTOPIA-hard, that is generally challenging for all models. We find that on this subset, GPT-4 achieves a significantly lower goal completion rate than humans and struggles to exhibit social commonsense reasoning and strategic communication skills. These findings demonstrate SOTOPIA's promise as a general platform for research on evaluating and improving social intelligence in artificial agents.


title: Chiral topological metals with multiple types of quasiparticle fermions and large spin Hall effect in the SrGePt family materials

abstract: We present a prediction of chiral topological metals with several classes of unconventional quasiparticle fermions in a family of SrGePt-type materials in terms of first-principles calculations. In these materials, fourfold spin-3/2 Rarita-Schwinger-Weyl (RSW) fermion, sixfold excitation, and Weyl fermions coexist around the Fermi level as spin-orbit coupling is considered, and the Chern number for the first two kinds of fermions is the maximal value four. We found that large Fermi arcs from spin-3/2 RSW fermion emerge on the (010)-surface, spanning the whole surface Brillouin zone. Moreover, there exist Fermi arcs originating from Weyl points, which further overlap with trivial bulk bands. In addition, we revealed that the large spin Hall conductivity can be obtained, which attributed to the remarkable spin Berry curvature around the degenerate nodes and band-splitting induced by spin-orbit coupling. Our findings indicate that the SrGePt family of compounds provide an excellent platform for studying on topological electronic states and the intrinsic spin Hall effect.


title: Magnetic eight-fold nodal-point and nodal-network fermions in MnB2

abstract: Realizing topological semimetal states with novel emergent fermions in magnetic materials is a focus of current research. Based on first-principle calculations and symmetry analysis, we reveal interesting magnetic emergent fermions in an existing material MnB2. In the temperature range from 157 K to 760 K, MnB2 is a collinear antiferromagnet. We find the coexistence of eightfold nodal points and nodal net close to the Fermi level, which are protected by the spin group in the absence of spin-orbit coupling. Depending on the Neel vector orientation, consideration of spin-orbit coupling will either open small gaps at these nodal features, or transform them into magnetic linear and quadratic Dirac points and nodal rings. Below 157 K, MnB2 acquires weak ferromagnetism due to spin tilting. We predict that this transition is accompanied by a drastic change in anomalous Hall response, from zero above 157 K to 200 $\Omega\cdot \text{cm}^{-1}$ below 157 K.


title: Prototype-based HyperAdapter for Sample-Efficient Multi-task Tuning

abstract: Parameter-efficient fine-tuning (PEFT) has shown its effectiveness in adapting the pre-trained language models to downstream tasks while only updating a small number of parameters. Despite the success, most existing methods independently adapt to each task without considering knowledge transfer between tasks and are limited to low-data regimes. To overcome this issue, we propose Prototype-based HyperAdapter (PHA), a novel framework built on the adapter-tuning and hypernetwork. It introduces an instance-dense retriever and a prototypical hypernetwork to generate the conditional modules in a sample-efficient manner. This leads to comparable performance improvements against existing PEFT methods on multi-task learning and few-shot transfer learning. More importantly, when the available data size gets smaller, our method outperforms other strong baselines by a large margin. Based on our extensive empirical experiments across various datasets, we demonstrate that PHA strikes a better trade-off between trainable parameters, accuracy on stream tasks, and sample efficiency.


title: MixEdit: Revisiting Data Augmentation and Beyond for Grammatical Error Correction

abstract: Data Augmentation through generating pseudo data has been proven effective in mitigating the challenge of data scarcity in the field of Grammatical Error Correction (GEC). Various augmentation strategies have been widely explored, most of which are motivated by two heuristics, i.e., increasing the distribution similarity and diversity of pseudo data. However, the underlying mechanism responsible for the effectiveness of these strategies remains poorly understood. In this paper, we aim to clarify how data augmentation improves GEC models. To this end, we introduce two interpretable and computationally efficient measures: Affinity and Diversity. Our findings indicate that an excellent GEC data augmentation strategy characterized by high Affinity and appropriate Diversity can better improve the performance of GEC models. Based on this observation, we propose MixEdit, a data augmentation approach that strategically and dynamically augments realistic data, without requiring extra monolingual corpora. To verify the correctness of our findings and the effectiveness of the proposed MixEdit, we conduct experiments on mainstream English and Chinese GEC datasets. The results show that MixEdit substantially improves GEC models and is complementary to traditional data augmentation methods.


title: Open-ended Commonsense Reasoning with Unrestricted Answer Scope

abstract: Open-ended Commonsense Reasoning is defined as solving a commonsense question without providing 1) a short list of answer candidates and 2) a pre-defined answer scope. Conventional ways of formulating the commonsense question into a question-answering form or utilizing external knowledge to learn retrieval-based methods are less applicable in the open-ended setting due to an inherent challenge. Without pre-defining an answer scope or a few candidates, open-ended commonsense reasoning entails predicting answers by searching over an extremely large searching space. Moreover, most questions require implicit multi-hop reasoning, which presents even more challenges to our problem. In this work, we leverage pre-trained language models to iteratively retrieve reasoning paths on the external knowledge base, which does not require task-specific supervision. The reasoning paths can help to identify the most precise answer to the commonsense question. We conduct experiments on two commonsense benchmark datasets. Compared to other approaches, our proposed method achieves better performance both quantitatively and qualitatively.


title: Detection of 12426 SB2 candidates in the LAMOST-MRS, using a binary spectral model

abstract: We use an updated method for the detection of double-lined spectroscopic binaries (SB2) using $v \sin{i}$ values from spectral fits. The method is applied to all spectra from LAMOST-MRS. Using this method, we detect 12426 SB2 candidates, where 4321 are already known and 8105 are new discoveries. We check their spectra manually to minimise possible false positives. We also detect several cases of contamination of the spectra by solar light. Additionally, for candidates with multiple observations we compute mass ratios with systemic velocities and determine Keplerian orbits. We present an updated catalogue of all SB2 candidates together with additional information for some of them in separate data tables.


title: Enhanced nonlinear optical effects in drift-biased nonreciprocal graphene plasmonics

abstract: Nonlinear light-matter interactions are typically enhanced by increasing the local field and its interaction time with matter. Conventional methods to achieve these goals are based on resonances or slow-light effects. However, these methods suffer from various issues, including narrow operational bandwidths, large footprints, and material absorption. An interesting alternative approach to enhance the local field is offered by nonreciprocal systems: by blocking the path of a unidirectional wave in a terminated nonreciprocal waveguiding structure, broadband electromagnetic fields can be drastically enhanced and localized near the termination. This approach was previously studied only in three-dimensional gyrotropic material platforms where the need for external magnets and bulky materials make it less practical. Here, instead, we employ a magnet-free mechanism to break reciprocity in 2D plasmonic materials, e.g., graphene. Specifically, we employ high-speed drifting electrons on a voltage-biased graphene sheet to lift the forward/backward degeneracy of the surface plasmon-polariton dispersion, creating modes with different propagation properties parallel and antiparallel to the current. We show that controllable, asymmetric, and intense field hot-spots are generated at the edges of a suitably terminated graphene metasurface. We then theoretically demonstrate that such asymmetric field hot-spots offer an effective solution to enhance third-order nonlinear optical effects. As an example, we predict that, using realistic values of drift velocity, high third-harmonic conversion efficiencies of up to 0.3 percent are achievable around the plasmon resonance frequencies.


title: From Relevance to Utility: Evidence Retrieval with Feedback for Fact Verification

abstract: Retrieval-enhanced methods have become a primary approach in fact verification (FV); it requires reasoning over multiple retrieved pieces of evidence to verify the integrity of a claim. To retrieve evidence, existing work often employs off-the-shelf retrieval models whose design is based on the probability ranking principle. We argue that, rather than relevance, for FV we need to focus on the utility that a claim verifier derives from the retrieved evidence. We introduce the feedback-based evidence retriever(FER) that optimizes the evidence retrieval process by incorporating feedback from the claim verifier. As a feedback signal we use the divergence in utility between how effectively the verifier utilizes the retrieved evidence and the ground-truth evidence to produce the final claim label. Empirical studies demonstrate the superiority of FER over prevailing baselines.


title: PREM: A Simple Yet Effective Approach for Node-Level Graph Anomaly Detection

abstract: Node-level graph anomaly detection (GAD) plays a critical role in identifying anomalous nodes from graph-structured data in various domains such as medicine, social networks, and e-commerce. However, challenges have arisen due to the diversity of anomalies and the dearth of labeled data. Existing methodologies - reconstruction-based and contrastive learning - while effective, often suffer from efficiency issues, stemming from their complex objectives and elaborate modules. To improve the efficiency of GAD, we introduce a simple method termed PREprocessing and Matching (PREM for short). Our approach streamlines GAD, reducing time and memory consumption while maintaining powerful anomaly detection capabilities. Comprising two modules - a pre-processing module and an ego-neighbor matching module - PREM eliminates the necessity for message-passing propagation during training, and employs a simple contrastive loss, leading to considerable reductions in training time and memory usage. Moreover, through rigorous evaluations of five real-world datasets, our method demonstrated robustness and effectiveness. Notably, when validated on the ACM dataset, PREM achieved a 5% improvement in AUC, a 9-fold increase in training speed, and sharply reduce memory usage compared to the most efficient baseline.


title: Improved Sample Complexity Analysis of Natural Policy Gradient Algorithm with General Parameterization for Infinite Horizon Discounted Reward Markov Decision Processes

abstract: We consider the problem of designing sample efficient learning algorithms for infinite horizon discounted reward Markov Decision Process. Specifically, we propose the Accelerated Natural Policy Gradient (ANPG) algorithm that utilizes an accelerated stochastic gradient descent process to obtain the natural policy gradient. ANPG achieves $\mathcal{O}({\epsilon^{-2}})$ sample complexity and $\mathcal{O}(\epsilon^{-1})$ iteration complexity with general parameterization where $\epsilon$ defines the optimality error. This improves the state-of-the-art sample complexity by a $\log(\frac{1}{\epsilon})$ factor. ANPG is a first-order algorithm and unlike some existing literature, does not require the unverifiable assumption that the variance of importance sampling (IS) weights is upper bounded. In the class of Hessian-free and IS-free algorithms, ANPG beats the best-known sample complexity by a factor of $\mathcal{O}(\epsilon^{-\frac{1}{2}})$ and simultaneously matches their state-of-the-art iteration complexity.


title: Using Experience Classification for Training Non-Markovian Tasks

abstract: Unlike the standard Reinforcement Learning (RL) model, many real-world tasks are non-Markovian, whose rewards are predicated on state history rather than solely on the current state. Solving a non-Markovian task, frequently applied in practical applications such as autonomous driving, financial trading, and medical diagnosis, can be quite challenging. We propose a novel RL approach to achieve non-Markovian rewards expressed in temporal logic LTL$_f$ (Linear Temporal Logic over Finite Traces). To this end, an encoding of linear complexity from LTL$_f$ into MDPs (Markov Decision Processes) is introduced to take advantage of advanced RL algorithms. Then, a prioritized experience replay technique based on the automata structure (semantics equivalent to LTL$_f$ specification) is utilized to improve the training process. We empirically evaluate several benchmark problems augmented with non-Markovian tasks to demonstrate the feasibility and effectiveness of our approach.


title: Solutions to the KP hierarchy with an elliptic background

abstract: A class of "elliptic soliton" solutions of the Kadomtsev-Petviashvili hierarchy, which includes a determinantal solution of Li and Zhang, is described in terms of pseudo-differential operator formulation. In our approach, the Li-Zhang solution is obtained by repeatedly applying the Darboux transformation to a stationary solution. Real-valued solutions are discussed and various examples that display web-like patterns are presented.


title: Trimmed Mean Group Estimation of Average Treatment Effects in Ultra Short T Panels under Correlated Heterogeneity

abstract: Under correlated heterogeneity, the commonly used two-way fixed effects estimator is biased and can lead to misleading inference. This paper proposes a new trimmed mean group (TMG) estimator which is consistent at the irregular rate of n^{1/3} even if the time dimension of the panel is as small as the number of its regressors. Extensions to panels with time effects are provided, and a Hausman-type test of correlated heterogeneity is proposed. Small sample properties of the TMG estimator (with and without time effects) are investigated by Monte Carlo experiments and shown to be satisfactory and perform better than other trimmed estimators proposed in the literature. The proposed test of correlated heterogeneity is also shown to have the correct size and satisfactory power. The utility of the TMG approach is illustrated with an empirical application.


title: Descriptive Knowledge Graph in Biomedical Domain

abstract: We present a novel system that automatically extracts and generates informative and descriptive sentences from the biomedical corpus and facilitates the efficient search for relational knowledge. Unlike previous search engines or exploration systems that retrieve unconnected passages, our system organizes descriptive sentences as a relational graph, enabling researchers to explore closely related biomedical entities (e.g., diseases treated by a chemical) or indirectly connected entities (e.g., potential drugs for treating a disease). Our system also uses ChatGPT and a fine-tuned relation synthesis model to generate concise and reliable descriptive sentences from retrieved information, reducing the need for extensive human reading effort. With our system, researchers can easily obtain both high-level knowledge and detailed references and interactively steer to the information of interest. We spotlight the application of our system in COVID-19 research, illustrating its utility in areas such as drug repurposing and literature curation.


title: Substrate interaction mediated control of phase separation in FIB milled Ag-Cu thin films

abstract: Nanofabrication is an integral part of realization of advanced functional devices ranging from optical displays to memory devices. Focused ion beam (FIB) milling is one of the widely used nanofabrication methods. Conventionally, FIB milling has been carried out for patterning single-phase stable thin films. However, the influence of FIB milling on phase separation of metastable alloy films during subsequent treatments has not been reported. Here, we show how FIB milling of Ag-Cu thin films influences the separation process and microstructure formation during post-milling annealing. Phase-separated microstructure of the film consists of fine, randomly distributed Ag-rich and Cu-rich domains, whereas adjacent to milled apertures (cylindrical holes), we observe two distinctly coarser rings. A combination of imaging and analysis techniques reveals Cu-rich islands dispersed in Ag-rich domains in the first ring next to the aperture, while the second ring constitutes mostly of Ag-rich grains. Copper silicide is observed to form in and around apertures through reaction with the Si-substrate. This substrate interaction, in addition to known variables like composition, temperature, and capillarity, appears to be a key element in drastically changing the local microstructure around apertures. This current study introduces new avenues to locally modulate the composition and microstructure through an appropriate choice of the film-substrate system. Such an ability can be exploited further to tune device functionalities with possible applications in plasmonics, catalysis, microelectronics and magnetics.


title: Treatment bootstrapping: A new approach to quantify uncertainty of average treatment effect estimates

abstract: This paper proposes a new non-parametric bootstrap method to quantify the uncertainty of average treatment effect estimate for the treated from matching estimators. More specifically, it seeks to quantify the uncertainty associated with the average treatment effect estimate for the treated by bootstrapping the treatment group only and finding the counterpart control group by pair matching on estimated propensity score without replacement. We demonstrate the validity of this approach and compare it with existing bootstrap approaches through Monte Carlo simulation and analysis of a real world data set. The results indicate that the proposed approach constructs confidence intervals and standard errors that have 95 percent or above coverage rate and better precision compared with existing bootstrap approaches, while these measures also depend on percent treated in the sample data and the sample size.


title: Quantum Speedups in Regret Analysis of Infinite Horizon Average-Reward Markov Decision Processes

abstract: This paper investigates the potential of quantum acceleration in addressing infinite horizon Markov Decision Processes (MDPs) to enhance average reward outcomes. We introduce an innovative quantum framework for the agent's engagement with an unknown MDP, extending the conventional interaction paradigm. Our approach involves the design of an optimism-driven tabular Reinforcement Learning algorithm that harnesses quantum signals acquired by the agent through efficient quantum mean estimation techniques. Through thorough theoretical analysis, we demonstrate that the quantum advantage in mean estimation leads to exponential advancements in regret guarantees for infinite horizon Reinforcement Learning. Specifically, the proposed Quantum algorithm achieves a regret bound of $\tilde{\mathcal{O}}(1)$, a significant improvement over the $\tilde{\mathcal{O}}(\sqrt{T})$ bound exhibited by classical counterparts.


title: Superiority of Softmax: Unveiling the Performance Edge Over Linear Attention

abstract: Large transformer models have achieved state-of-the-art results in numerous natural language processing tasks. Among the pivotal components of the transformer architecture, the attention mechanism plays a crucial role in capturing token interactions within sequences through the utilization of softmax function. Conversely, linear attention presents a more computationally efficient alternative by approximating the softmax operation with linear complexity. However, it exhibits substantial performance degradation when compared to the traditional softmax attention mechanism. In this paper, we bridge the gap in our theoretical understanding of the reasons behind the practical performance gap between softmax and linear attention. By conducting a comprehensive comparative analysis of these two attention mechanisms, we shed light on the underlying reasons for why softmax attention outperforms linear attention in most scenarios.


title: Deflation conjecture and local dimensions of Brent equations

abstract: In this paper, a classical deflation process raised by Dayton, Li and Zeng is realized for the Brent equations, which provides new bounds for local dimensions of the solution set. Originally, this deflation process focuses on isolated solutions. We generalize it to the case of irreducible components and a related conjecture is given. We analyze its realization and apply it to the Brent equations. The decrease of the nullities is easily observed. So the deflation process can be served as a useful tool for determining the local dimensions. In addition, our result implies that along with the decrease of the tensor rank, the singular solutions will become more and more.


title: Are research contributions assigned differently under the two contributorship classification systems in PLoS ONE?

abstract: Contributorship statements have been effective at recording granular author contributions in research articles and have been broadly used to understand how labor is divided across research teams. However, one major limitation in existing empirical studies is that two classification systems have been adopted, especially from its most important data source, journals published by the Public Library of Science (PLoS). This research aims to address this limitation by developing a mapping scheme between the two systems and using it to understand whether there are differences in the assignment of contribution by authors under the two systems. We use all research articles published in PLoS ONE between 2012 to 2020, divided into two five-year publication windows centered by the shift of the classification systems in 2016. Our results show that most tasks (except for writing- and resource-related tasks) are used similarly under the two systems. Moreover, notable differences between how researchers used the two systems are also examined and discussed. This research offers an important foundation for empirical research on division of labor in the future, by enabling a larger dataset that crosses both, and potentially other, classification systems.


title: The origin of correlation between mass and angle in quasi-fission

abstract: Mass-angle distribution (MAD) measurement of heavy and superheavy element fragmentation reactions is one of the powerful tools for investigating the mechanism of fission and fusion process. MAD shows a strong correlation between mass and angle when the quasi-fission event is dominant. It has characteristic that appears diagonal correlation as long as the quasi-fission event is dominant. This diagonal correlation could not be reproduced in previous our model before the introduction of the parameters. In this study, we systematically evaluate the unknown model parameters contained in our model and clarify those model parameters to reproduce the diagonal correlation that appears in MAD. Using a dynamical model based on the fluctuation dissipation theorem that employs Langevin equations, we calculate MADs of two reaction systems $^{48}$Ti+$^{186}$W and $^{34}$S+$^{232}$Th which are dominated by quasi-fission. We were able to clarify the effects of unknown model parameters on the MAD. In addition, we identified the values of model parameters that can reproduce the correlation between mass and angle. As a result, it was found that the balance of tangential friction and moment of inertia values is important for the correlation between mass and angle.


title: Adaptation with Self-Evaluation to Improve Selective Prediction in LLMs

abstract: Large language models (LLMs) have recently shown great advances in a variety of tasks, including natural language understanding and generation. However, their use in high-stakes decision-making scenarios is still limited due to the potential for errors. Selective prediction is a technique that can be used to improve the reliability of the LLMs by allowing them to abstain from making predictions when they are unsure of the answer. In this work, we propose a novel framework for adaptation with self-evaluation to improve the selective prediction performance of LLMs. Our framework is based on the idea of using parameter-efficient tuning to adapt the LLM to the specific task at hand while improving its ability to perform self-evaluation. We evaluate our method on a variety of question-answering (QA) datasets and show that it outperforms state-of-the-art selective prediction methods. For example, on the CoQA benchmark, our method improves the AUACC from 91.23% to 92.63% and improves the AUROC from 74.61% to 80.25%.


title: Deep learning based on Transformer architecture for power system short-term voltage stability assessment with class imbalance

abstract: Most existing data-driven power system short-term voltage stability assessment (STVSA) approaches presume class-balanced input data. However, in practical applications, the occurrence of short-term voltage instability following a disturbance is minimal, leading to a significant class imbalance problem and a consequent decline in classifier performance. This work proposes a Transformer-based STVSA method to address this challenge. By utilizing the basic Transformer architecture, a stability assessment Transformer (StaaT) is developed {as a classification model to reflect the correlation between the operational states of the system and the resulting stability outcomes}. To combat the negative impact of imbalanced datasets, this work employs a conditional Wasserstein generative adversarial network with gradient penalty (CWGAN-GP) for synthetic data generation, aiding in the creation of a balanced, representative training set for the classifier. Semi-supervised clustering learning is implemented to enhance clustering quality, addressing the lack of a unified quantitative criterion for short-term voltage stability. {Numerical tests on the IEEE 39-bus test system extensively demonstrate that the proposed method exhibits robust performance under class imbalances up to 100:1 and noisy environments, and maintains consistent effectiveness even with an increased penetration of renewable energy}. Comparative results reveal that the CWGAN-GP generates more balanced datasets than traditional oversampling methods and that the StaaT outperforms other deep learning algorithms. This study presents a compelling solution for real-world STVSA applications that often face class imbalance and data noise challenges.


title: Universality properties of forcing

abstract: The purpose of this paper is to investigate forcing as a tool to construct universal models. In particular, we look at theories of initial segments of the universe and show that any model of a sufficiently rich fragment of those theories can be embedded into a model constructed by forcing. Our results rely on the model-theoretic properties of good ultrafilters, for which we provide a new existence proof on non-necessarily complete Boolean algebras.


title: Random Sampling of Bandlimited Graph Signals from Local Measurements

abstract: The random sampling on graph signals is one of the fundamental topics in graph signal processing. In this letter, we consider the random sampling of k-bandlimited signals from the local measurements and show that no more than O(klogk) measurements with replacement are sufficient for the accurate and stable recovery of any k-bandlimited graph signals. We propose two random sampling strategies based on the minimum measurements, i.e., the optimal sampling and the estimated sampling. The geodesic distance between vertices is introduced to design the sampling probability distribution. Numerical experiments are included to show the effectiveness of the proposed methods.


title: AUC-mixup: Deep AUC Maximization with Mixup

abstract: While deep AUC maximization (DAM) has shown remarkable success on imbalanced medical tasks, e.g., chest X-rays classification and skin lesions classification, it could suffer from severe overfitting when applied to small datasets due to its aggressive nature of pushing prediction scores of positive data away from that of negative data. This paper studies how to improve generalization of DAM by mixup data augmentation -- an approach that is widely used for improving generalization of the cross-entropy loss based deep learning methods. %For overfitting issues arising from limited data, the common approach is to employ mixup data augmentation to boost the models' generalization performance by enriching the training data. However, AUC is defined over positive and negative pairs, which makes it challenging to incorporate mixup data augmentation into DAM algorithms. To tackle this challenge, we employ the AUC margin loss and incorporate soft labels into the formulation to effectively learn from data generated by mixup augmentation, which is referred to as the AUC-mixup loss. Our experimental results demonstrate the effectiveness of the proposed AUC-mixup methods on imbalanced benchmark and medical image datasets compared to standard DAM training methods.


title: Nonlinear stability for 3-D plane Poiseuille flow in a finite channel

abstract: In this paper, we study the nonlinear stability for the 3-D plane Poiseuille flow $(1-y^2,0,0)$ at high Reynolds number $Re$ in a finite channel $\mathbb{T}\times [-1,1 ]\times \mathbb{T}$ with non-slip boundary condition. We prove that if the initial velocity $v_0$ satisfies $\|v_0-(1-y^2,0,0)\|_{H^{4}}\leq c_0 Re^{-\frac{7}{4}}$ for some $c_0>0$ independent of $Re$, then the solution of 3-D Naiver-Stokes equations is global in time and does not transit away from the plane Poiseuille flow. To our knowledge, this is the first nonlinear stability result for the 3-D plane Poiseuille flow and the transition threshold is accordant with the numerical result by Lundbladh et al. \cite{LHR}.


title: Advances in Atomic Time Scale imaging with a Fine Intrinsic Spatial Resolution

abstract: Atomic time scale imaging, opening a new era for studying dynamics in microcosmos, is presently attracting immense research interesting on the global level due to its powerful ability. On the atom level, physics, chemistry, and biology are identical for researching atom motion and atomic state change. The light possesses twoness, the information carrier and the research resource. The most fundamental principle of this imaging is that light records the event modulated light field by itself, so called all optical imaging. This paper can answer what is the essential standard to develop and evaluate atomic time scale imaging, what is the optimal imaging system, and what are the typical techniques to implement this imaging, up to now. At present, the best record in the experiment, made by multistage optical parametric amplification (MOPA), is realizing 50 fs resolved optical imaging with a spatial resolution of ~83 lp/mm at an effective framing rate of 10^13 fps for recording an ultrafast optical lattice with its rotating speed up to 10^13 rad/s.


title: MOHO: Learning Single-view Hand-held Object Reconstruction with Multi-view Occlusion-Aware Supervision

abstract: Previous works concerning single-view hand-held object reconstruction typically rely on supervision from 3D ground-truth models, which are hard to collect in real world. In contrast, readily accessible hand-object videos offer a promising training data source, but they only give heavily occluded object observations. In this paper, we present a novel synthetic-to-real framework to exploit Multi-view Occlusion-aware supervision from hand-object videos for Hand-held Object reconstruction (MOHO) from a single image, tackling two predominant challenges in such setting: hand-induced occlusion and object's self-occlusion. First, in the synthetic pre-training stage, we render a large-scaled synthetic dataset SOMVideo with hand-object images and multi-view occlusion-free supervisions, adopted to address hand-induced occlusion in both 2D and 3D spaces. Second, in the real-world finetuning stage, MOHO leverages the amodal-mask-weighted geometric supervision to mitigate the unfaithful guidance caused by the hand-occluded supervising views in real world. Moreover, domain-consistent occlusion-aware features are amalgamated in MOHO to resist object's self-occlusion for inferring the complete object shape. Extensive experiments on HO3D and DexYCB datasets demonstrate 2D-supervised MOHO gains superior results against 3D-supervised methods by a large margin.


title: Asymptotic behavior of homological invariants of localizations of modules

abstract: Let $R$ be a commutative noetherian ring, $I$ an ideal of $R$, and $M$ a finitely generated $R$-module. We consider the asymptotic injective dimensions, projective dimensions, Bass numbers, and Betti numbers of localizations of $M/I^n M$ at prime ideals of $R$ and prove that these invariants are stable or have polynomial growth for large integers $n$ that do not depend on the prime ideals.


title: Complex numbers with a prescribed order of approximation and Zaremba's conjecture

abstract: Given $b=-A\pm i$ with $A$ being a positive integer, we can represent any complex number as a power series in $b$ with coefficients in $\mathcal A=\{0,1,\ldots, A^2\}$. We prove that, for any real $\tau\geq 2$ and any non-empty proper subset $J(b)$ of $\mathcal A$, there are uncountably many complex numbers (including transcendental numbers) that can be expressed as a power series in $b$ with coefficients in $J(b)$ and with the irrationality exponent (in terms of Gaussian integers) equal to $\tau$. One of the key ingredients in our construction is the `Folding Lemma' applied to Hurwitz continued fractions. This motivates a Hurwitz continued fraction analogue of the well-known Zaremba's conjecture. We prove several results in support of this conjecture.


title: MISAR: A Multimodal Instructional System with Augmented Reality

abstract: Augmented reality (AR) requires the seamless integration of visual, auditory, and linguistic channels for optimized human-computer interaction. While auditory and visual inputs facilitate real-time and contextual user guidance, the potential of large language models (LLMs) in this landscape remains largely untapped. Our study introduces an innovative method harnessing LLMs to assimilate information from visual, auditory, and contextual modalities. Focusing on the unique challenge of task performance quantification in AR, we utilize egocentric video, speech, and context analysis. The integration of LLMs facilitates enhanced state estimation, marking a step towards more adaptive AR systems. Code, dataset, and demo will be available at https://github.com/nguyennm1024/misar.


title: Runner re-identification from single-view running video in the open-world setting

abstract: In many sports, player re-identification is crucial for automatic video processing and analysis. However, most of the current studies on player re-identification in multi- or single-view sports videos focus on re-identification in the closed-world setting using labeled image dataset, and player re-identification in the open-world setting for automatic video analysis is not well developed. In this paper, we propose a runner re-identification system that directly processes single-view video to address the open-world setting. In the open-world setting, we cannot use labeled dataset and have to process video directly. The proposed system automatically processes raw video as input to identify runners, and it can identify runners even when they are framed out multiple times. For the automatic processing, we first detect the runners in the video using the pre-trained YOLOv8 and the fine-tuned EfficientNet. We then track the runners using ByteTrack and detect their shoes with the fine-tuned YOLOv8. Finally, we extract the image features of the runners using an unsupervised method with the gated recurrent unit autoencoder and global and local features mixing. To improve the accuracy of runner re-identification, we use shoe images as local image features and dynamic features of running sequence images. We evaluated the system on a running practice video dataset and showed that the proposed method identified runners with higher accuracy than some state-of-the-art models in unsupervised re-identification. We also showed that our proposed local image feature and running dynamic feature were effective for runner re-identification. Our runner re-identification system can be useful for the automatic analysis of running videos.


title: Spinors and Descartes' Theorem

abstract: Descartes' circle theorem relates the curvatures of four mutually externally tangent circles, three "petal" circles around the exterior of a central circle, forming a "$3$-flower" configuration. We generalise this theorem to the case of an "$n$-flower", consisting of $n$ tangent circles around the exterior of a central circle, and give an explicit equation satisfied by their curvatures. The proof uses a spinorial description of horospheres in hyperbolic geometry.


title: DPF-Nutrition: Food Nutrition Estimation via Depth Prediction and Fusion

abstract: A reasonable and balanced diet is essential for maintaining good health. With the advancements in deep learning, automated nutrition estimation method based on food images offers a promising solution for monitoring daily nutritional intake and promoting dietary health. While monocular image-based nutrition estimation is convenient, efficient, and economical, the challenge of limited accuracy remains a significant concern. To tackle this issue, we proposed DPF-Nutrition, an end-to-end nutrition estimation method using monocular images. In DPF-Nutrition, we introduced a depth prediction module to generate depth maps, thereby improving the accuracy of food portion estimation. Additionally, we designed an RGB-D fusion module that combined monocular images with the predicted depth information, resulting in better performance for nutrition estimation. To the best of our knowledge, this was the pioneering effort that integrated depth prediction and RGB-D fusion techniques in food nutrition estimation. Comprehensive experiments performed on Nutrition5k evaluated the effectiveness and efficiency of DPF-Nutrition.


title: A Comprehensive Survey on Vector Database: Storage and Retrieval Technique, Challenge

abstract: A vector database is used to store high-dimensional data that cannot be characterized by traditional DBMS. Although there are not many articles describing existing or introducing new vector database architectures, the approximate nearest neighbor search problem behind vector databases has been studied for a long time, and considerable related algorithmic articles can be found in the literature. This article attempts to comprehensively review relevant algorithms to provide a general understanding of this booming research area. The basis of our framework categorises these studies by the approach of solving ANNS problem, respectively hash-based, tree-based, graph-based and quantization-based approaches. Then we present an overview of existing challenges for vector databases. Lastly, we sketch how vector databases can be combined with large language models and provide new possibilities.


title: Gallai's path decomposition conjecture for cartesian product of graphs (\uppercase\expandafter{\romannumeral 2})

abstract: Let $G$ be a graph of order $n$. A path decomposition $\mathcal{P}$ of $G$ is a collection of edge-disjoint paths that covers all the edges of $G$. Let $p(G)$ denote the minimum number of paths needed in a path decomposition of $G$. Gallai conjectured that if $G$ is connected, then $p(G)\leq \lceil\frac{n}{2}\rceil$. In this paper, we prove that Gallai's path decomposition conjecture holds for the cartesian product $G\Box H$, where $H$ is any graph and $G$ is a unicyclic graph or a bicyclic graph.


title: Random minimum spanning tree and dense graph limits

abstract: A theorem of Frieze from 1985 asserts that the total weight of the minimum spanning tree of the complete graph $K_n$ whose edges get independent weights from the distribution $UNIFORM[0,1]$ converges to Ap\'ery's constant in probability, as $n\to\infty$. We generalize this result to sequences of graphs $G_n$ that converge to a graphon $W$. Further, we allow the weights of the edges to be drawn from different distributions (subject to moderate conditions). The limiting total weight $\kappa(W)$ of the minimum spanning tree is expressed in terms of a certain branching process defined on $W$, which was studied previously by Bollob\'as, Janson and Riordan in connection with the giant component in inhomogeneous random graphs.


title: MalDICT: Benchmark Datasets on Malware Behaviors, Platforms, Exploitation, and Packers

abstract: Existing research on malware classification focuses almost exclusively on two tasks: distinguishing between malicious and benign files and classifying malware by family. However, malware can be categorized according to many other types of attributes, and the ability to identify these attributes in newly-emerging malware using machine learning could provide significant value to analysts. In particular, we have identified four tasks which are under-represented in prior work: classification by behaviors that malware exhibit, platforms that malware run on, vulnerabilities that malware exploit, and packers that malware are packed with. To obtain labels for training and evaluating ML classifiers on these tasks, we created an antivirus (AV) tagging tool called ClarAVy. ClarAVy's sophisticated AV label parser distinguishes itself from prior AV-based taggers, with the ability to accurately parse 882 different AV label formats used by 90 different AV products. We are releasing benchmark datasets for each of these four classification tasks, tagged using ClarAVy and comprising nearly 5.5 million malicious files in total. Our malware behavior dataset includes 75 distinct tags - nearly 7x more than the only prior benchmark dataset with behavioral tags. To our knowledge, we are the first to release datasets with malware platform and packer tags.


title: Learning under Label Proportions for Text Classification

abstract: We present one of the preliminary NLP works under the challenging setup of Learning from Label Proportions (LLP), where the data is provided in an aggregate form called bags and only the proportion of samples in each class as the ground truth. This setup is inline with the desired characteristics of training models under Privacy settings and Weakly supervision. By characterizing some irregularities of the most widely used baseline technique DLLP, we propose a novel formulation that is also robust. This is accompanied with a learnability result that provides a generalization bound under LLP. Combining this formulation with a self-supervised objective, our method achieves better results as compared to the baselines in almost 87% of the experimental configurations which include large scale models for both long and short range texts across multiple metrics.


title: Experimental Results of Underwater Sound Speed Profile Inversion by Few-shot Multi-task Learning

abstract: Underwater Sound Speed Profile (SSP) distribution has great influence on the propagation mode of acoustic signal, thus the fast and accurate estimation of SSP is of great importance in building underwater observation systems. The state-of-the-art SSP inversion methods include frameworks of matched field processing (MFP), compressive sensing (CS), and feedforeward neural networks (FNN), among which the FNN shows better real-time performance while maintain the same level of accuracy. However, the training of FNN needs quite a lot historical SSP samples, which is diffcult to be satisfied in many ocean areas. This situation is called few-shot learning. To tackle this issue, we propose a multi-task learning (MTL) model with partial parameter sharing among different traning tasks. By MTL, common features could be extracted, thus accelerating the learning process on given tasks, and reducing the demand for reference samples, so as to enhance the generalization ability in few-shot learning. To verify the feasibility and effectiveness of MTL, a deep-ocean experiment was held in April 2023 at the South China Sea. Results shows that MTL outperforms the state-of-the-art methods in terms of accuracy for SSP inversion, while inherits the real-time advantage of FNN during the inversion stage.


title: Live Graph Lab: Towards Open, Dynamic and Real Transaction Graphs with NFT

abstract: Numerous studies have been conducted to investigate the properties of large-scale temporal graphs. Despite the ubiquity of these graphs in real-world scenarios, it's usually impractical for us to obtain the whole real-time graphs due to privacy concerns and technical limitations. In this paper, we introduce the concept of {\it Live Graph Lab} for temporal graphs, which enables open, dynamic and real transaction graphs from blockchains. Among them, Non-fungible tokens (NFTs) have become one of the most prominent parts of blockchain over the past several years. With more than \$40 billion market capitalization, this decentralized ecosystem produces massive, anonymous and real transaction activities, which naturally forms a complicated transaction network. However, there is limited understanding about the characteristics of this emerging NFT ecosystem from a temporal graph analysis perspective. To mitigate this gap, we instantiate a live graph with NFT transaction network and investigate its dynamics to provide new observations and insights. Specifically, through downloading and parsing the NFT transaction activities, we obtain a temporal graph with more than 4.5 million nodes and 124 million edges. Then, a series of measurements are presented to understand the properties of the NFT ecosystem. Through comparisons with social, citation, and web networks, our analyses give intriguing findings and point out potential directions for future exploration. Finally, we also study machine learning models in this live graph to enrich the current datasets and provide new opportunities for the graph community. The source codes and dataset are available at https://livegraphlab.github.io.


title: Learning Co-Speech Gesture for Multimodal Aphasia Type Detection

abstract: Aphasia, a language disorder resulting from brain damage, requires accurate identification of specific aphasia types, such as Broca's and Wernicke's aphasia, for effective treatment. However, little attention has been paid to developing methods to detect different types of aphasia. Recognizing the importance of analyzing co-speech gestures for distinguish aphasia types, we propose a multimodal graph neural network for aphasia type detection using speech and corresponding gesture patterns. By learning the correlation between the speech and gesture modalities for each aphasia type, our model can generate textual representations sensitive to gesture information, leading to accurate aphasia type detection. Extensive experiments demonstrate the superiority of our approach over existing methods, achieving state-of-the-art results (F1 84.2\%). We also show that gesture features outperform acoustic features, highlighting the significance of gesture expression in detecting aphasia types. We provide the codes for reproducibility purposes.


title: Risk Bounds for Quantile Additive Trend Filtering

abstract: This paper investigates risk bounds for quantile additive trend filtering, a method gaining increasing significance in the realms of additive trend filtering and quantile regression. We investigate the constrained version of quantile trend filtering within additive models, considering both fixed and growing input dimensions. In the fixed dimension case, we discover an error rate that mirrors the non-quantile minimax rate for additive trend filtering, featuring the main term $n^{-2r/(2r+1)}V^{2/(2r+1)}$, when the underlying quantile function is additive, with components whose $(r-1)$th derivatives are of bounded variation by $V$. In scenarios with a growing input dimension $d$, quantile additive trend filtering introduces a polynomial factor of $d^{(2r+2)/(2r+1)}$. This aligns with the non-quantile variant, featuring a linear factor $d$, particularly pronounced for larger $r$ values. Additionally, we propose a practical algorithm for implementing quantile trend filtering within additive models, using dimension-wise backfitting. We conduct experiments with evenly spaced data points or data that samples from a uniform distribution in the interval $[0,1]$, applying distinct component functions and introducing noise from normal and heavy-tailed distributions. Our findings confirm the estimator's convergence as $n$ increases and its superiority, particularly in heavy-tailed distribution scenarios. These results deepen our understanding of additive trend filtering models in quantile settings, offering valuable insights for practical applications and future research.


title: Finite-Size Scaling of the High-Dimensional Ising Model in the Loop Representation

abstract: Besides its original spin representation, the Ising model is known to have the Fortuin-Kasteleyn (FK) bond and loop representations, of which the former was recently shown to exhibit two upper critical dimensions $(d_c=4,d_p=6)$. Using a lifted worm algorithm, we determine the critical coupling as $K_c = 0.077\,708\,91(4)$ for $d=7$, which significantly improves over the previous results, and then study critical geometric properties of the loop-Ising clusters on tori for spatial dimensions $d=5$ to 7. We show that, as the spin representation, the loop Ising model has only one upper critical dimension at $d_c=4$. However, sophisticated finite-size scaling (FSS) behaviors, like two length scales, two configuration sectors and two scaling windows, still exist as the interplay effect of the Gaussian fixed point and complete-graph asymptotics. Moreover, using the Loop-Cluster algorithm, we provide an intuitive understanding of the emergence of the percolation-like upper critical dimension $d_p=6$ in the FK-Ising model. As a consequence, a unified physical picture is established for the FSS behaviors in all the three representations of the Ising model above $d_c=4$.


title: Separating Invisible Sounds Toward Universal Audiovisual Scene-Aware Sound Separation

abstract: The audio-visual sound separation field assumes visible sources in videos, but this excludes invisible sounds beyond the camera's view. Current methods struggle with such sounds lacking visible cues. This paper introduces a novel "Audio-Visual Scene-Aware Separation" (AVSA-Sep) framework. It includes a semantic parser for visible and invisible sounds and a separator for scene-informed separation. AVSA-Sep successfully separates both sound types, with joint training and cross-modal alignment enhancing effectiveness.


title: On the Distributed Evaluation of Generative Models

abstract: The evaluation of deep generative models has been extensively studied in the centralized setting, where the reference data are drawn from a single probability distribution. On the other hand, several applications of generative models concern distributed settings, e.g. the federated learning setting, where the reference data for conducting evaluation are provided by several clients in a network. In this paper, we study the evaluation of generative models in such distributed contexts with potentially heterogeneous data distributions across clients. We focus on the widely-used distance-based evaluation metrics, Fr\'echet Inception Distance (FID) and Kernel Inception Distance (KID). In the case of KID metric, we prove that scoring a group of generative models using the clients' averaged KID score will result in the same ranking as that of a centralized KID evaluation over a collective reference set containing all the clients' data. In contrast, we show the same result does not apply to the FID-based evaluation. We provide examples in which two generative models are assigned the same FID score by each client in a distributed setting, while the centralized FID scores of the two models are significantly different. We perform several numerical experiments on standard image datasets and generative models to support our theoretical results on the distributed evaluation of generative models using FID and KID scores.


title: Enhancing Low-resource Fine-grained Named Entity Recognition by Leveraging Coarse-grained Datasets

abstract: Named Entity Recognition (NER) frequently suffers from the problem of insufficient labeled data, particularly in fine-grained NER scenarios. Although $K$-shot learning techniques can be applied, their performance tends to saturate when the number of annotations exceeds several tens of labels. To overcome this problem, we utilize existing coarse-grained datasets that offer a large number of annotations. A straightforward approach to address this problem is pre-finetuning, which employs coarse-grained data for representation learning. However, it cannot directly utilize the relationships between fine-grained and coarse-grained entities, although a fine-grained entity type is likely to be a subcategory of a coarse-grained entity type. We propose a fine-grained NER model with a Fine-to-Coarse(F2C) mapping matrix to leverage the hierarchical structure explicitly. In addition, we present an inconsistency filtering method to eliminate coarse-grained entities that are inconsistent with fine-grained entity types to avoid performance degradation. Our experimental results show that our method outperforms both $K$-shot learning and supervised learning methods when dealing with a small number of fine-grained annotations.


title: Reflection-Tuning: Data Recycling Improves LLM Instruction-Tuning

abstract: Recent advancements in Large Language Models (LLMs) have expanded the horizons of natural language understanding and generation. Notably, the output control and alignment with the input of LLMs can be refined through instruction tuning. However, as highlighted in several studies, low-quality data in the training set are usually detrimental to instruction tuning, resulting in inconsistent or even misleading LLM outputs. We propose a novel method, termed "reflection-tuning," which addresses the problem by self-improvement and judging capabilities of LLMs. This approach utilizes an oracle LLM to recycle the original training data by introspecting and enhancing the quality of instructions and responses in the data. Extensive experiments on widely used evaluation benchmarks show that LLMs trained with our recycled data outperform those trained with existing datasets in various benchmarks.


title: Circumgalactic Medium at High Halo Masses -- Signatures of Cold Gas Depletion in Luminous Red Galaxies

abstract: We study ultraviolet HI and metal line transitions in the circumgalactic medium (CGM) of 15 massive, quenched luminous red galaxies (LRGs) at redshift $z\sim 0.5$ and with impact parameters up to 400 kpc. We selected 8 of LRG-CGM systems to study general properties of the CGM around LRGs, while the other 7 are already known to contain cool CGM gas from MgII optical studies (MgII-LRGs). In the general LRGs population, we detect HI in 4 of 8 LRGs, in all cases with $N_{HI} < 10^{16.7} {\rm cm^{-2}}$. In contrast, all MgII-LRGs show HI; for four LRGs the HI column density is $N_{HI} \gtrsim 10^{18} {\rm cm^{-2}}$. The CGM of LRGs also shows low and intermediate ionized lines (such as CIII, CII, SiIII, SiII) and highly ionized lines of OVI (we detect OVI around 5 of 7 MgII-LRGs and 1 of 8 in the random sample). Next, we combine our sample with literature LRGs and $\lesssim L^{*}$ galaxies and we find that while for $\lesssim L^{*}$ galaxies CGM HI Ly$\alpha$ absorption is stronger as galaxies are more massive, the cool CGM traced by HI Ly$\alpha$ is suppressed above stellar masses of $M* \sim 10^{11.5}$ $M_{\odot}$. While most LRG CGM systems show weak or non-detectable OVI (equivalent width less than 0.2 \AA), a few LRG CGM systems show strong OVI 1031, which in most cases likely originates from groups containing both a LRG and a blue star-forming neighboring galaxy.


title: Large-scale behaviour of Sobolev functions in Ahlfors regular metric measure spaces

abstract: In this paper, we study the behaviour at infinity of $p$-Sobolev functions in the setting of Ahlfors $Q$-regular metric measure spaces supporting a $p$-Poincar\'e inequality. By introducing the notions of sets which are $p$-thin at infinity, we show that functions in the homogeneous space $\dot N^{1,p}(X)$ necessarily have limits at infinity outside of $p$-thin sets, when $1\le p<Q<+\infty$. When $p>Q$, we show by example that uniqueness of limits at infinity may fail for functions in $\dot N^{1,p}(X)$. While functions in $\dot N^{1,p}(X)$ may not have any reasonable limit at infinity when $p=Q$, we introduce the notion of a $Q$-thick set at infinity, and characterize the limits of functions in $\dot N^{1,Q}(X)$ along infinite curves in terms of limits outside $Q$-thin sets and along $Q$-thick sets. By weakening the notion of a thick set, we show that a function in $\dot N^{1,Q}(X)$ with a limit along such an almost thick set may fail to have a limit along any infinite curve. While homogeneous $p$-Sobolev functions may have infinite limits at infinity when $p\ge Q$, we provide bounds on how quickly such functions may grow: when $p=Q$, functions in $\dot N^{1,p}(X)$ have sub-logarithmic growth at infinity, whereas when $p>Q$, such functions have growth at infinity controlled by $d(\cdot, O)^{1-Q/p}$, where $O$ is a fixed base point in $X$. For the inhomogeneous spaces $N^{1,p}(X)$, the phenomenon is different. We show that for $1\le p\le Q$, the limit of a function $u\in N^{1,p}(X)$ is zero outside of a $p$-thin set, whereas $\lim_{x\to+\infty}u(x)=0$ for all $u\in N^{1,p}(X)$ when $p>Q$.


title: Representable distributive quasi relation algebras

abstract: We give a definition of representability for distributive quasi relation algebras (DqRAs). These algebras are a generalisation of relation algebras and were first described by Galatos and Jipsen (2013). Our definition uses a construction that starts with a poset. The algebra is concretely constructed as the lattice of upsets of a partially ordered equivalence relation. The key to defining the three negation-like unary operations is to impose certain symmetry requirements on the partial order. Our definition of representable distributive quasi relation algebras is easily seen to be a generalisation of the definition of representable relations algebras by Jonsson and Tarski (1948). We give examples of representable DqRAs and give a necessary condition for an algebra to be finitely representable. We leave open the questions of whether every DqRA is representable, and also whether the class of representable DqRAs forms a variety. Moreover, our definition provides many other opportunities for investigations in the spirit of those carried out for representable relation algebras.


title: The shortest lengths and the enclosure method for time dependent problems

abstract: In this paper, we discuss the role of the shortest distance in time-dependent enclosure method for the inverse problems when the inclusions are embedded in a non-layered or two-layered medium. Furthermore, the regularity assumptions for the boundaries of the inclusions are relaxed.


title: Chain-of-Thought Tuning: Masked Language Models can also Think Step By Step in Natural Language Understanding

abstract: Chain-of-Thought (CoT) is a technique that guides Large Language Models (LLMs) to decompose complex tasks into multi-step reasoning through intermediate steps in natural language form. Briefly, CoT enables LLMs to think step by step. However, although many Natural Language Understanding (NLU) tasks also require thinking step by step, LLMs perform less well than small-scale Masked Language Models (MLMs). To migrate CoT from LLMs to MLMs, we propose Chain-of-Thought Tuning (CoTT), a two-step reasoning framework based on prompt tuning, to implement step-by-step thinking for MLMs on NLU tasks. From the perspective of CoT, CoTT's two-step framework enables MLMs to implement task decomposition; CoTT's prompt tuning allows intermediate steps to be used in natural language form. Thereby, the success of CoT can be extended to NLU tasks through MLMs. To verify the effectiveness of CoTT, we conduct experiments on two NLU tasks: hierarchical classification and relation extraction, and the results show that CoTT outperforms baselines and achieves state-of-the-art performance.


title: Quantifying Self-diagnostic Atomic Knowledge in Chinese Medical Foundation Model: A Computational Analysis

abstract: Foundation Models (FMs) have the potential to revolutionize the way users self-diagnose through search engines by offering direct and efficient suggestions. Recent studies primarily focused on the quality of FMs evaluated by GPT-4 or their ability to pass medical exams, no studies have quantified the extent of self-diagnostic atomic knowledge stored in FMs' memory, which is the basis of foundation models to provide factual and reliable suggestions. In this paper, we first constructed a benchmark of Self-diagnostic Atomic Knowledge (SdAK), including the most common types of atomic knowledge involved in self-diagnostic queries, with 17 atomic types and a total of 14, 048 pieces of atomic knowledge. Then, we evaluated both generic and open-source Chinese medical FMs on the benchmark. The experimental results showcase that generic FMs perform better than medical FMs in terms of self-diagnostic atomic knowledge. Error analysis revealed that both generic and medical FMs are sycophantic, e.g., always catering to users' claims when it comes to unknown knowledge. We further explored different types of data commonly adopted for fine-tuning medical FMs, i.e., real-world, semi-distilled, and distilled data, and found that distilled data can benefit FMs most. The code and data are available at https://github.com/FreedomIntelligence/SDAK.


title: Uncertainty in Automated Ontology Matching: Lessons Learned from an Empirical Experimentation

abstract: Data integration is considered a classic research field and a pressing need within the information science community. Ontologies play a critical role in such a process by providing well-consolidated support to link and semantically integrate datasets via interoperability. This paper approaches data integration from an application perspective, looking at techniques based on ontology matching. An ontology-based process may only be considered adequate by assuming manual matching of different sources of information. However, since the approach becomes unrealistic once the system scales up, automation of the matching process becomes a compelling need. Therefore, we have conducted experiments on actual data with the support of existing tools for automatic ontology matching from the scientific community. Even considering a relatively simple case study (i.e., the spatio-temporal alignment of global indicators), outcomes clearly show significant uncertainty resulting from errors and inaccuracies along the automated matching process. More concretely, this paper aims to test on real-world data a bottom-up knowledge-building approach, discuss the lessons learned from the experimental results of the case study, and draw conclusions about uncertainty and uncertainty management in an automated ontology matching process. While the most common evaluation metrics clearly demonstrate the unreliability of fully automated matching solutions, properly designed semi-supervised approaches seem to be mature for a more generalized application.


title: Simultaneous Nonparametric Inference of M-regression under Complex Temporal Dynamics

abstract: The paper considers simultaneous nonparametric inference for a wide class of M-regression models with time-varying coefficients. The covariates and errors of the regression model are tackled as a general class of nonstationary time series and are allowed to be cross-dependent. We construct $\sqrt{n}$-consistent inference for the cumulative regression function, whose limiting properties are disclosed using Bahadur representation and Gaussian approximation theory. A simple and unified self-convolved bootstrap procedure is proposed. With only one tuning parameter, the bootstrap consistently simulates the desired limiting behavior of the M-estimators under complex temporal dynamics, even under the possible presence of breakpoints in time series. Our methodology leads to a unified framework to conduct general classes of Exact Function Tests, Lack-of-fit Tests, and Qualitative Tests for the time-varying coefficients under complex temporal dynamics. These tests enable one to, among many others, conduct variable selection procedures, check for constancy and linearity, as well as verify shape assumptions, including monotonicity and convexity. As applications, our method is utilized to study the time-varying properties of global climate data and Microsoft stock return, respectively.


title: VST++: Efficient and Stronger Visual Saliency Transformer

abstract: While previous CNN-based models have exhibited promising results for salient object detection (SOD), their ability to explore global long-range dependencies is restricted. Our previous work, the Visual Saliency Transformer (VST), addressed this constraint from a transformer-based sequence-to-sequence perspective, to unify RGB and RGB-D SOD. In VST, we developed a multi-task transformer decoder that concurrently predicts saliency and boundary outcomes in a pure transformer architecture. Moreover, we introduced a novel token upsampling method called reverse T2T for predicting a high-resolution saliency map effortlessly within transformer-based structures. Building upon the VST model, we further propose an efficient and stronger VST version in this work, i.e. VST++. To mitigate the computational costs of the VST model, we propose a Select-Integrate Attention (SIA) module, partitioning foreground into fine-grained segments and aggregating background information into a single coarse-grained token. To incorporate 3D depth information with low cost, we design a novel depth position encoding method tailored for depth maps. Furthermore, we introduce a token-supervised prediction loss to provide straightforward guidance for the task-related tokens. We evaluate our VST++ model across various transformer-based backbones on RGB, RGB-D, and RGB-T SOD benchmark datasets. Experimental results show that our model outperforms existing methods while achieving a 25% reduction in computational costs without significant performance compromise. The demonstrated strong ability for generalization, enhanced performance, and heightened efficiency of our VST++ model highlight its potential.


title: Taming Charged Defects: Large Scale Purification in Semiconductors using Rydberg Excitons

abstract: We investigate the interaction between highly excited Rydberg excitons and charged impurities in the semiconductor Cuprous Oxide. We find that it is long-ranged and based on charge-induced dipole interactions. We demonstrate that we can utilize this interaction to neutralize impurities throughout the whole crystal - an effect we call purification. Purification reduces detrimental electrical stray fields drastically. We find that the absorption of the purified crystal increases by up to 25 % and that the purification effect is long-lived and may persist for hundreds of microseconds or even longer. Using a time-resolved pump-probe technique, we can discriminate purification from Rydberg blockade, which has been a long-standing goal in excitonic Rydberg systems.


title: Testing the cosmological principle with the Pantheon+ sample and the region-fitting method

abstract: The cosmological principle is fundamental to the standard cosmological model. It assumes that the Universe is homogeneous and isotropic on very large scales. As the basic assumption, it must stand the test of various observations. In this work, using the region fitting (RF) method, we mapped the all-sky distribution of cosmological parameters ($\Omega_{m}$ and $H_{0}$) and find that the distribution significantly deviates from isotropy. A local matter underdensity region exists toward (${308.4^{\circ}}$$_{-48.7}^{+47.6}$, ${-18.2^{\circ}}$$_{-28.8}^{+21.1}$) as well as a preferred direction of the cosmic anisotropy (${313.4^{\circ}}$$_{-18.2}^{+19.6}$, ${-16.8^{\circ}}$$_{-10.7}^{+11.1}$) in galactic coordinates. Similar directions may imply that local matter density might be responsible for the anisotropy of the accelerated expansion of the Universe. Results of statistical isotropy analyses including Isotropy and Isotropy with real-data positions (RP) show high confidence levels. For the local matter underdensity, the statistical significances are 2.78$\sigma$ (isotropy) and 2.34$\sigma$ (isotropy RP). For the cosmic anisotropy, the statistical significances are 3.96$\sigma$ (isotropy) and 3.15$\sigma$ (isotropy RP). The comparison of these two kinds of statistical isotropy analyses suggests that inhomogeneous spatial distribution of real sample can increase the deviation from isotropy. The similar results and findings are also found from reanalyses of the low-redshift sample (lp+) and the lower screening angle ($\theta_\mathrm{max}$ = 60$^{\circ}$), but with a slight decrease in statistical significance. Overall, our results provide clear indications for a possible cosmic anisotropy. This possibility must be taken seriously. Further testing is needed to better understand this signal.


title: EchoScan: Scanning Complex Indoor Geometries via Acoustic Echoes

abstract: Accurate estimation of indoor space geometries is vital for constructing precise digital twins, whose broad industrial applications include navigation in unfamiliar environments and efficient evacuation planning, particularly in low-light conditions. This study introduces EchoScan, a deep neural network model that utilizes acoustic echoes to perform room geometry inference. Conventional sound-based techniques rely on estimating geometry-related room parameters such as wall position and room size, thereby limiting the diversity of inferable room geometries. Contrarily, EchoScan overcomes this limitation by directly inferring room floorplans and heights, thereby enabling it to handle rooms with arbitrary shapes, including curved walls. The key innovation of EchoScan is its ability to analyze the complex relationship between low- and high-order reflections in room impulse responses (RIRs) using a multi-aggregation module. The analysis of high-order reflections also enables it to infer complex room shapes when echoes are unobservable from the position of an audio device. Herein, EchoScan was trained and evaluated using RIRs synthesized from complex environments, including the Manhattan and Atlanta layouts, employing a practical audio device configuration compatible with commercial, off-the-shelf devices. Compared with vision-based methods, EchoScan demonstrated outstanding geometry estimation performance in rooms with various shapes.


title: Diagrammatic representation and nonperturbative approximation of exact time-convolutionless master equation

abstract: The time-convolutionless master equation provides a general framework to model non-Markovian dynamics of an open quantum system with a time-local generator. A diagrammatic representation is developed and proven for the perturbative expansion of the exact time-local generator for an open quantum system interacting with arbitrary environments. A truncation of the perturbation expansion leads to the perturbative time-convolutionless quantum master equations. We further introduce a nonperturbative approach that approximates the time-convolutionless generator as a nested time-ordered exponential function.

categories: quant-ph math-ph math.MP physics.chem-ph


title: Federated Heterogeneous Graph Neural Network for Privacy-preserving Recommendation

abstract: The heterogeneous information network (HIN), which contains rich semantics depicted by meta-paths, has emerged as a potent tool for mitigating data sparsity in recommender systems. Existing HIN-based recommender systems operate under the assumption of centralized storage and model training. However, real-world data is often distributed due to privacy concerns, leading to the semantic broken issue within HINs and consequent failures in centralized HIN-based recommendations. In this paper, we suggest the HIN is partitioned into private HINs stored on the client side and shared HINs on the server. Following this setting, we propose a federated heterogeneous graph neural network (FedHGNN) based framework, which facilitates collaborative training of a recommendation model using distributed HINs while protecting user privacy. Specifically, we first formalize the privacy definition for HIN-based federated recommendation (FedRec) in the light of differential privacy, with the goal of protecting user-item interactions within private HIN as well as users' high-order patterns from shared HINs. To recover the broken meta-path based semantics and ensure proposed privacy measures, we elaborately design a semantic-preserving user interactions publishing method, which locally perturbs user's high-order patterns and related user-item interactions for publishing. Subsequently, we introduce an HGNN model for recommendation, which conducts node- and semantic-level aggregations to capture recovered semantics. Extensive experiments on four datasets demonstrate that our model outperforms existing methods by a substantial margin (up to 34% in HR@10 and 42% in NDCG@10) under a reasonable privacy budget.


title: Action-Quantized Offline Reinforcement Learning for Robotic Skill Learning

abstract: The offline reinforcement learning (RL) paradigm provides a general recipe to convert static behavior datasets into policies that can perform better than the policy that collected the data. While policy constraints, conservatism, and other methods for mitigating distributional shifts have made offline reinforcement learning more effective, the continuous action setting often necessitates various approximations for applying these techniques. Many of these challenges are greatly alleviated in discrete action settings, where offline RL constraints and regularizers can often be computed more precisely or even exactly. In this paper, we propose an adaptive scheme for action quantization. We use a VQ-VAE to learn state-conditioned action quantization, avoiding the exponential blowup that comes with na\"ive discretization of the action space. We show that several state-of-the-art offline RL methods such as IQL, CQL, and BRAC improve in performance on benchmarks when combined with our proposed discretization scheme. We further validate our approach on a set of challenging long-horizon complex robotic manipulation tasks in the Robomimic environment, where our discretized offline RL algorithms are able to improve upon their continuous counterparts by 2-3x. Our project page is at https://saqrl.github.io/


title: Investigating Uncertainty Calibration of Aligned Language Models under the Multiple-Choice Setting

abstract: Despite the significant progress made in practical applications of aligned language models (LMs), they tend to be overconfident in output answers compared to the corresponding pre-trained LMs. In this work, we systematically evaluate the impact of the alignment process on logit-based uncertainty calibration of LMs under the multiple-choice setting. We first conduct a thoughtful empirical study on how aligned LMs differ in calibration from their pre-trained counterparts. Experimental results reveal that there are two distinct uncertainties in LMs under the multiple-choice setting, which are responsible for the answer decision and the format preference of the LMs, respectively. Then, we investigate the role of these two uncertainties on aligned LM's calibration through fine-tuning in simple synthetic alignment schemes and conclude that one reason for aligned LMs' overconfidence is the conflation of these two types of uncertainty. Furthermore, we examine the utility of common post-hoc calibration methods for aligned LMs and propose an easy-to-implement and sample-efficient method to calibrate aligned LMs. We hope our findings could provide insights into the design of more reliable alignment processes for LMs.


title: DBDNet:Partial-to-Partial Point Cloud Registration with Dual Branches Decoupling

abstract: Point cloud registration plays a crucial role in various computer vision tasks, and usually demands the resolution of partial overlap registration in practice. Most existing methods perform a serial calculation of rotation and translation, while jointly predicting overlap during registration, this coupling tends to degenerate the registration performance. In this paper, we propose an effective registration method with dual branches decoupling for partial-to-partial registration, dubbed as DBDNet. Specifically, we introduce a dual branches structure to eliminate mutual interference error between rotation and translation by separately creating two individual correspondence matrices. For partial-to-partial registration, we consider overlap prediction as a preordering task before the registration procedure. Accordingly, we present an overlap predictor that benefits from explicit feature interaction, which is achieved by the powerful attention mechanism to accurately predict pointwise masks. Furthermore, we design a multi-resolution feature extraction network to capture both local and global patterns thus enhancing both overlap prediction and registration module. Experimental results on both synthetic and real datasets validate the effectiveness of our proposed method.


title: Classification of 2-Orthogonal Polynomials with Brenke Type Generating Functions

abstract: The Brenke type generating functions are the polynomial generating functions of the form $$\sum_{n=0}^{\infty}{P_n(x )\over n!}t^n=A(t)B(xt), $$ where $A$ and $B$ are two formal power series subject to the conditions $A(0)\;B^{(k)}(0)\neq0,\, k=0,1,2\ldots$.\\ In this work, we determine all Brenke-type polynomials when they are also $2$-orthogonal polynomial sets, that is to say, polynomials satisfying one standard four-term recurrence relation. That allows us, on one hand, to obtain new 2-orthogonal sequences generalizing known orthogonal families of polynomials, and on the other hand, to recover particular cases of polynomial sequences discovered in the context of $d$-orthogonality.\\ The classification is based on the resolution of a three-order difference equation induced by the four-term recurrence relation satisfied by the considered polynomials. This study is motivated by the work of Chihara who gave all pairs $(A (t), B(t))$ for which $\{P_n(x)\}_{n\geq 0}$ is an orthogonal polynomial sequence.


title: Performance of FPGA controller in ISAC-1 accelerator chain

abstract: The LLRF of five of TRIUMF's ISAC-1 accelerator cavities have been replaced by 3 similar FPGA based system with different operating frequencies. These LLRF use internal digital phase locked loops for frequency generation and synchronization, feedback control using Amplitude/Phase regulations. These FPGAs also have internal stepper motor controller for resonance control. Various modes of resonance control are possible, including phase comparison and minimum seeking slide-mode control. Operational performances including frequency generation and synchronization, amplitude and phase noises, tuning speeds, compatibility to original remote controls, are reported.


title: Kernel Learning in Ridge Regression "Automatically" Yields Exact Low Rank Solution

abstract: We consider kernels of the form $(x,x') \mapsto \phi(\|x-x'\|^2_\Sigma)$ parametrized by $\Sigma$. For such kernels, we study a variant of the kernel ridge regression problem which simultaneously optimizes the prediction function and the parameter $\Sigma$ of the reproducing kernel Hilbert space. The eigenspace of the $\Sigma$ learned from this kernel ridge regression problem can inform us which directions in covariate space are important for prediction. Assuming that the covariates have nonzero explanatory power for the response only through a low dimensional subspace (central mean subspace), we find that the global minimizer of the finite sample kernel learning objective is also low rank with high probability. More precisely, the rank of the minimizing $\Sigma$ is with high probability bounded by the dimension of the central mean subspace. This phenomenon is interesting because the low rankness property is achieved without using any explicit regularization of $\Sigma$, e.g., nuclear norm penalization. Our theory makes correspondence between the observed phenomenon and the notion of low rank set identifiability from the optimization literature. The low rankness property of the finite sample solutions exists because the population kernel learning objective grows "sharply" when moving away from its minimizers in any direction perpendicular to the central mean subspace.


title: Comparison of detachment in Ohmic plasmas with positive and negative triangularity

abstract: In recent years, negative triangularity (NT) has emerged as a potential high-confinement L-mode reactor solution. In this work, detachment is investigated using core density ramps in lower single null Ohmic L-mode plasmas across a wide range of upper, lower, and average triangularity (the mean of upper and lower triangularity: $\delta$) in the TCV tokamak. It is universally found that detachment is more difficult to access for NT shaping. The outer divertor leg of discharges with $\delta\approx -0.3$ could not be cooled to below $5~\mathrm{eV}$ through core density ramps alone. The behavior of the upstream plasma and geometrical divertor effects (e.g. a reduced connection length with negative lower triangularity) do not fully explain the challenges in detaching NT plasmas. Langmuir probe measurements of the target heat flux widths ($\lambda_q$) were constant to within 30% across an upper triangularity scan, while the spreading factor $S$ was lower by up to 50% for NT, indicating a generally lower integral Scrape-Off Layer width, $\lambda_{int}$. The line-averaged core density was typically higher for NT discharges for a given fuelling rate, possibly linked to higher particle confinement in NT. Conversely, the divertor neutral pressure and integrated particle fluxes to the targets were typically lower for the same line-averaged density, indicating that NT configurations may be closer to the sheath-limited regime than their PT counterparts, which may explain why NT is more challenging to detach.


title: Unleashing the Power of Clippy in Real-World Rust Projects

abstract: Clippy lints are considered as essential tools for Rust developers, as they can be configured as gate-keeping rules for a Rust project during continuous integration. Despite their availability, little was known about practical application and cost-effectiveness of the lints in reducing code quality issues. In this study, we embark on a comprehensive analysis to unveil the true impact of Clippy lints in the Rust development landscape. The study is structured around three interrelated components, each contributing to the overall effectiveness of Clippy. Firstly, we conduct a comprehensive analysis of Clippy lints in all idiomatic crates-io Rust projects with an average warning density of 21/KLOC. The analysis identifies the most cost-effective lint fixes, offering valuable opportunities for optimizing code quality. Secondly, we actively engage Rust developers through a user survey to garner invaluable feedback on their experiences with Clippy. User insights shed light on two crucial concerns: the prevalence of false positives in warnings and the need for auto-fix support for most warnings. Thirdly, building upon these findings, we engineer three innovative automated refactoring techniques to effectively fix the four most frequent Clippy lints. As a result, the warning density in Rosetta benchmarks has significantly decreased from 195/KLOC to an impressive 18/KLOC, already lower than the average density of the crates-io Rust projects. These results demonstrate tangible benefit and impact of our efforts in enhancing the overall code quality and maintainability for Rust developers.