title: Towards Self-Contained Answers: Entity-Based Answer Rewriting in Conversational Search

abstract: Conversational information-seeking (CIS) is an emerging paradigm for knowledge acquisition and exploratory search. Traditional web search interfaces enable easy exploration of entities, but this is limited in conversational settings due to the limited-bandwidth interface. This paper explore ways to rewrite answers in CIS, so that users can understand them without having to resort to external services or sources. Specifically, we focus on salient entities -- entities that are central to understanding the answer. As our first contribution, we create a dataset of conversations annotated with entities for saliency. Our analysis of the collected data reveals that the majority of answers contain salient entities. As our second contribution, we propose two answer rewriting strategies aimed at improving the overall user experience in CIS. One approach expands answers with inline definitions of salient entities, making the answer self-contained. The other approach complements answers with follow-up questions, offering users the possibility to learn more about specific entities. Results of a crowdsourcing-based study indicate that rewritten answers are clearly preferred over the original ones. We also find that inline definitions tend to be favored over follow-up questions, but this choice is highly subjective, thereby providing a promising future direction for personalization.


title: NeuSpeech: Decode Neural signal as Speech

abstract: Decoding language from brain dynamics is an important open direction in the realm of brain-computer interface (BCI), especially considering the rapid growth of large language models. Compared to invasive-based signals which require electrode implantation surgery, non-invasive neural signals (e.g. EEG, MEG) have attracted increasing attention considering their safety and generality. However, the exploration is not adequate in three aspects: 1) previous methods mainly focus on EEG but none of the previous works address this problem on MEG with better signal quality; 2) prior works have predominantly used $``teacher-forcing"$ during generative decoding, which is impractical; 3) prior works are mostly $``BART-based"$ not fully auto-regressive, which performs better in other sequence tasks. In this paper, we explore the brain-to-text translation of MEG signals in a speech-decoding formation. Here we are the first to investigate a cross-attention-based ``whisper" model for generating text directly from MEG signals without teacher forcing. Our model achieves impressive BLEU-1 scores of 60.30 and 52.89 without pretraining $\&$ teacher-forcing on two major datasets ($\textit{GWilliams}$ and $\textit{Schoffelen}$). This paper conducts a comprehensive review to understand how speech decoding formation performs on the neural decoding tasks, including pretraining initialization, training $\&$ evaluation set splitting, augmentation, and scaling law. Code is available at https://github.com/NeuSpeech/NeuSpeech1$.


title: Differentially Private Synthetic Data via Foundation Model APIs 2: Text

abstract: Text data has become extremely valuable due to the emergence of machine learning algorithms that learn from it. A lot of high-quality text data generated in the real world is private and therefore cannot be shared or used freely due to privacy concerns. Generating synthetic replicas of private text data with a formal privacy guarantee, i.e., differential privacy (DP), offers a promising and scalable solution. However, existing methods necessitate DP finetuning of large language models (LLMs) on private data to generate DP synthetic data. This approach is not viable for proprietary LLMs (e.g., GPT-3.5) and also demands considerable computational resources for open-source LLMs. Lin et al. (2024) recently introduced the Private Evolution (PE) algorithm to generate DP synthetic images with only API access to diffusion models. In this work, we propose an augmented PE algorithm, named Aug-PE, that applies to the complex setting of text. We use API access to an LLM and generate DP synthetic text without any model training. We conduct comprehensive experiments on three benchmark datasets. Our results demonstrate that Aug-PE produces DP synthetic text that yields competitive utility with the SOTA DP finetuning baselines. This underscores the feasibility of relying solely on API access of LLMs to produce high-quality DP synthetic texts, thereby facilitating more accessible routes to privacy-preserving LLM applications. Our code and data are available at https://github.com/AI-secure/aug-pe.


title: On duality of four dimensional $\mathcal{N}=1$ gauge theory

abstract: We show that Seiberg-like duality of $\mathcal{N}=1$ gauge theory coupled with tensor chiral fields and fundamental chiral fields works if the meson spectrum built from the tensor fields takes particular form: a) It should be truncated; b) The $R$ charges of tensor fields $\{R_a\}$ and the truncated mesons $\{R_j\}$ take very special values. The meson spectrum so that the duality works is encoded elegantly in the factorization of the polynomial $y^n-1=\Phi_{+}\Phi_{-}$. Our consideration covers many known $\mathcal{N}=1$ dualities and generates a large class of new examples.


title: Spatio-temporal optical vortices: principles of description and basic properties

abstract: These notes appeared as a summary during the initial acquaintance with the structure and properties of spatio-temporal optical vortices (STOV), as these are presented in the current literature. The general approach to the STOV description and characterization is based on the model of scalar paraxial Gaussian wave packet. On this ground, the STOV structures of arbitrary orders are considered as superpositions of spatio-temporal Hermite-Gaussian modes. This representation enables the direct and physically meaningful characterization of the STOV amplitude and phase distributions, their evolution upon free propagation and in optical systems, internal energy flows and the orbital angular momentum. The topologically determined asymmetry and the difference between the "energy center" and "probability center" [Phys. Rev. A 107, L031501 (2023)] is discussed and qualitatively interpreted. Methods for the STOV generation and diagnostics are outlined, and the main properties of non-Gaussian (Bessel-type) STOVs are briefly described. The notes may be useful as initial introduction to the STOV-associated ideas and their extraordinary properties.


title: Cooperative and Interaction-aware Driver Model for Lane Change Maneuver

abstract: To achieve complete autonomous vehicles, it is crucial for autonomous vehicles to communicate and interact with their surrounding vehicles. Especially, since the lane change scenarios do not have traffic signals and traffic rules, the interactions between vehicles need to be considered for the autonomous vehicles. To address this issue, we propose a cooperative and interaction-aware decision-making algorithm for autonomous vehicles that stochastically considers the future behavior of surrounding vehicles based on actual driving data. The algorithm is designed for both lane changing and lane keeping vehicles, and effectively considers interaction by using an interaction model based on relative information between vehicles with fewer states. To design the decision-making, the interaction model is defined as Markov decision process, and stochastic dynamic programming is used to solve the Markov decision process. We validate the effectiveness of our proposed algorithm in lane change scenarios that require interaction. Our results demonstrate that the proposed algorithm enables cooperative and interaction-aware decision-making while accommodating various driving styles. Additionally, by comparing it with other methods, such as the intelligent driver model and game theory-based decision-making, we validate the safety and comfortable decision-making of our proposed algorithm. Furthermore, through driving with a human-driven vehicle, it is confirmed that the proposed decision-making enables to cooperatively and effectively drive with humans.


title: Training-Free Pretrained Model Merging

abstract: Recently, model merging techniques have surfaced as a solution to combine multiple single-talent models into a single multi-talent model. However, previous endeavors in this field have either necessitated additional training or fine-tuning processes, or require that the models possess the same pre-trained initialization. In this work, we identify a common drawback in prior works w.r.t. the inconsistency of unit similarity in the weight space and the activation space. To address this inconsistency, we propose an innovative model merging framework, coined as merging under dual-space constraints (MuDSC). Specifically, instead of solely maximizing the objective of a single space, we advocate for the exploration of permutation matrices situated in a region with a unified high similarity in the dual space, achieved through the linear combination of activation and weight similarity matrices. In order to enhance usability, we have also incorporated adaptations for group structure, including Multi-Head Attention and Group Normalization. Comprehensive experimental comparisons demonstrate that MuDSC can significantly boost the performance of merged models with various task combinations and architectures. Furthermore, the visualization of the merged model within the multi-task loss landscape reveals that MuDSC enables the merged model to reside in the overlapping segment, featuring a unified lower loss for each task. Our code is publicly available at https://github.com/zju-vipa/training_free_model_merging.


title: Derivative-Free Optimization for Low-Rank Adaptation in Large Language Models

abstract: Parameter-efficient tuning methods such as LoRA could achieve comparable performance to model tuning by tuning a small portion of the parameters. However, substantial computational resources are still required, as this process involves calculating gradients and performing back-propagation throughout the model. Much effort has recently been devoted to utilizing the derivative-free optimization method to eschew the computation of gradients and showcase an augmented level of robustness in few-shot settings. In this paper, we prepend the low-rank modules into each self-attention layer of the model and employ two derivative-free optimization methods to optimize these low-rank modules at each layer alternately. Extensive results on various tasks and language models demonstrate that our proposed method achieves substantial improvement and exhibits clear advantages in memory usage and convergence speed compared to existing gradient-based parameter-efficient tuning and derivative-free optimization methods in few-shot settings.


title: AI Language Models Could Both Help and Harm Equity in Marine Policymaking: The Case Study of the BBNJ Question-Answering Bot

abstract: AI Large Language Models (LLMs) like ChatGPT are set to reshape some aspects of policymaking processes. Policy practitioners are already using ChatGPT for help with a variety of tasks: from drafting statements, submissions, and presentations, to conducting background research. We are cautiously hopeful that LLMs could be used to promote a marginally more balanced footing among decision makers in policy negotiations by assisting with certain tedious work, particularly benefiting developing countries who face capacity constraints that put them at a disadvantage in negotiations. However, the risks are particularly concerning for environmental and marine policy uses, due to the urgency of crises like climate change, high uncertainty, and trans-boundary impact. To explore the realistic potentials, limitations, and equity risks for LLMs in marine policymaking, we present a case study of an AI chatbot for the recently adopted Biodiversity Beyond National Jurisdiction Agreement (BBNJ), and critique its answers to key policy questions. Our case study demonstrates the dangers of LLMs in marine policymaking via their potential bias towards generating text that favors the perspectives of mainly Western economic centers of power, while neglecting developing countries' viewpoints. We describe several ways these biases can enter the system, including: (1) biases in the underlying foundational language models; (2) biases arising from the chatbot's connection to UN negotiation documents, and (3) biases arising from the application design. We urge caution in the use of generative AI in ocean policy processes and call for more research on its equity and fairness implications. Our work also underscores the need for developing countries' policymakers to develop the technical capacity to engage with AI on their own terms.


title: Attention Guidance Mechanism for Handwritten Mathematical Expression Recognition

abstract: Handwritten mathematical expression recognition (HMER) is challenging in image-to-text tasks due to the complex layouts of mathematical expressions and suffers from problems including over-parsing and under-parsing. To solve these, previous HMER methods improve the attention mechanism by utilizing historical alignment information. However, this approach has limitations in addressing under-parsing since it cannot correct the erroneous attention on image areas that should be parsed at subsequent decoding steps. This faulty attention causes the attention module to incorporate future context into the current decoding step, thereby confusing the alignment process. To address this issue, we propose an attention guidance mechanism to explicitly suppress attention weights in irrelevant areas and enhance the appropriate ones, thereby inhibiting access to information outside the intended context. Depending on the type of attention guidance, we devise two complementary approaches to refine attention weights: self-guidance that coordinates attention of multiple heads and neighbor-guidance that integrates attention from adjacent time steps. Experiments show that our method outperforms existing state-of-the-art methods, achieving expression recognition rates of 60.75% / 61.81% / 63.30% on the CROHME 2014/ 2016/ 2019 datasets.


title: How Multimodal Integration Boost the Performance of LLM for Optimization: Case Study on Capacitated Vehicle Routing Problems

abstract: Recently, large language models (LLMs) have notably positioned them as capable tools for addressing complex optimization challenges. Despite this recognition, a predominant limitation of existing LLM-based optimization methods is their struggle to capture the relationships among decision variables when relying exclusively on numerical text prompts, especially in high-dimensional problems. Keeping this in mind, we first propose to enhance the optimization performance using multimodal LLM capable of processing both textual and visual prompts for deeper insights of the processed optimization problem. This integration allows for a more comprehensive understanding of optimization problems, akin to human cognitive processes. We have developed a multimodal LLM-based optimization framework that simulates human problem-solving workflows, thereby offering a more nuanced and effective analysis. The efficacy of this method is evaluated through extensive empirical studies focused on a well-known combinatorial optimization problem, i.e., capacitated vehicle routing problem. The results are compared against those obtained from the LLM-based optimization algorithms that rely solely on textual prompts, demonstrating the significant advantages of our multimodal approach.


title: AFBT GAN: enhanced explainability and diagnostic performance for cognitive decline by counterfactual generative adversarial network

abstract: Existing explanation results of functional connectivity (FC) are normally generated by using classification result labels and correlation analysis methods such as Pearson's correlation or gradient backward. However, the diagnostic model is still trained on the black box model and might lack the attention of FCs in important regions during the training. To enhance the explainability and improve diagnostic performance, providing prior knowledge on neurodegeneration-related regions when healthy subjects (HC) develop into subject cognitive decline (SCD) and mild cognitive impairment (MCI) for the diagnostic model is a key step. To better determine the neurodegeneration-related regions, we employ counterfactual reasoning to generate the target label FC matrices derived from source label FC and then subtract source label FC with target label FC. The counterfactual reasoning architecture is constructed by adaptive forward and backward transformer generative adversarial network (AFBT GAN), which is specifically designed by network property in FC and inverse patch embedding operation in the transformer. The specific design can make the model focus more on the current network correlation and employ the global insight of the transformer to reconstruct FC, which both help the generation of high-quality target label FC. The validation experiments are conducted on both clinical and public datasets, the generated attention map are both vital correlated to cognitive function and the diagnostic performance is also significant. The code is available at https://github.com/SXR3015/AFBT-GAN.


title: Open-world Machine Learning: A Review and New Outlooks

abstract: Machine learning has achieved remarkable success in many applications. However, existing studies are largely based on the closed-world assumption, which assumes that the environment is stationary, and the model is fixed once deployed. In many real-world applications, this fundamental and rather naive assumption may not hold because an open environment is complex, dynamic, and full of unknowns. In such cases, rejecting unknowns, discovering novelties, and then incrementally learning them, could enable models to be safe and evolve continually as biological systems do. This paper provides a holistic view of open-world machine learning by investigating unknown rejection, novel class discovery, and class-incremental learning in a unified paradigm. The challenges, principles, and limitations of current methodologies are discussed in detail. Finally, we discuss several potential directions for future research. This paper aims to provide a comprehensive introduction to the emerging open-world machine learning paradigm, to help researchers build more powerful AI systems in their respective fields, and to promote the development of artificial general intelligence.


title: Quantum Computation by Cooling

abstract: Adiabatic quantum computation is a paradigmatic model aiming to solve a computational problem by finding the many-body ground state encapsulating the solution. However, its use of an adiabatic evolution depending on the spectral gap of an intricate many-body Hamiltonian makes its analysis daunting. While it is plausible to directly cool the final gapped system of the adiabatic evolution instead, the analysis of such a scheme on a general ground is missing. Here, we propose a specific Hamiltonian model for this purpose. The scheme is inspired by cavity cooling, involving the emulation of a zero-temperature reservoir. Repeated discarding of ancilla reservoir qubits extracts the entropy of the system, driving the system toward its ground state. At the same time, the measurement of the discarded qubits hints at the energy level structure of the system as a return. We show that quantum computation based on this cooling procedure is equivalent in its computational power to the one based on quantum circuits. We then exemplify the scheme with a few illustrative use cases for combinatorial optimization problems. In the first example, the cooling is free from any local energy minima, reducing the scheme to Grover's search algorithm with a few improvements. In the second example, the cooling suffers from abundant local energy minima. To circumvent this, we implant a mechanism in the Hamiltonian so that the population trapped in the local minima can tunnel out by high-order transitions. We support this idea with a numerical simulation for a particular combinatorial optimization problem. We also discuss its application to preparing quantum many-body ground states, arguing that the spectral gap is a crucial factor in determining the time scale of the cooling.


title: Observation of $\psi(3686)\to 3\phi$

abstract: Using $(2.712\pm0.014)\times 10^9$ $\psi(3686)$ events collected by the BESIII detector operating at the BEPCII collider, we report the first observation of $\psi(3686)\to 3\phi$ decay with a significance larger than 10$\sigma$. The branching fraction of this decay is determined to be $(1.46\pm0.05\pm0.17)\times10^{-5}$, where the first uncertainty is statistical and the second is systematic. No significant structure is observed in the $\phi\phi$ invariant mass spectra.


title: Contextuality, superlocality and supernoncontextuality

abstract: Contextuality is a fundamental manifestation of nonclassicality, indicating that for certain quantum correlations, sets of jointly measurable variables cannot be pre-assigned values independently of the measurement context. In this work, we characterize nonclassical quantum correlation beyond contextuality, in terms of supernoncontextuality, namely the higher-than-quantum hidden-variable(HV) dimensionality required to reproduce the given noncontextual quantum correlations. Thus supernoncontextuality is the contextuality analogue of superlocality. Specifically, we study the quantum system of two-qubit states in a scenario composed of five contexts that demonstrate contextuality in a state-dependent fashion. For this purpose, we use the framework of boxes, whose behavior is described by a set of probabilities satisfying the no-disturbance conditions. We observe that superlocal states must have sufficiently a high HV dimension in order to lead to a contextual box. On the other hand, a noncontextual superlocal box can be supernoncontextual, but superlocality is not a necessary condition. For sublocal (i.e., not superlocal) boxes, supernoncontextuality arises owing to a different type of simultaneous correlation in two MUBs present in any nonproduct state and correlations due to nonlocal measurements. From an operational perspective, the superlocal states that can or cannot be used to demonstrate contextuality can be distinguished by quantum correlations in two and three mutually unbiased bases (MUBs) of the discordant correlations in the states.


title: Spectroscopic Constraints on the Mid-Infrared Attenuation Curve: I -- Attenuation Model using PAH Emission

abstract: We introduce a novel model to spectroscopically constrain the mid-infrared (MIR) extinction/attenuation curve from 3--17 um, using Polycyclic Aromatic Hydrocarbon (PAH) emission drawn from an AKARI-Spitzer extragalactic cross-archival dataset. Currently proposed MIR extinction curves vary significantly in their slopes toward the near-infrared, and the variation of the strengths and shapes of the 9.7 um and 18 um silicate absorption features make MIR spectral modeling and interpretation challenging, particularly for heavily obscured galaxies. By adopting the basic premise that PAH bands have relatively consistent intrinsic ratios within dusty starbursting galaxies, we can, for the first time, empirically determine the overall shape of the MIR attenuation curve by measuring the differential attenuation at specific PAH wavelengths. Our attenuation model shows PAH emission in most (U)LIRGs is unambiguously subjected to attenuation, and we find strong evidence that PAH bands undergo differential attenuation as obscuration increases. Compared to pre-existing results, the MIR attenuation curve derived from the model favors relatively gray continuum absorption from 3-8 $\mu$m and silicate features with intermediate strength at 9.7 um but with stronger than typical 18 um opacity.


title: A study of the merging dwarf galaxy VCC322

abstract: Galaxy interactions and mergers can enhance or reduce star formation, but a complete understanding of the involved processes is still lacking. The effect of dwarf galaxy mergers is even less clear than their massive counterpart. We present a study on a dwarf merger remnant in the Virgo cluster, VCC322, which might form a triple system with VCC334 and VCC319. We identify a prominent long and straight tail-like substructure that has a size comparable to its host galaxy VCC322. By comparing the color-color ($g-r$ vs. $r-H$) distribution with simple stellar population models, we infer that the metallicity and stellar age of this tail are $Z_\star \sim 0.02~Z_\odot$ and $t_\star \sim 10$~Gyr, respectively. In VCC319, we find a sign of isophotal twisting. This suggests that VCC319 may be subject to tidal interaction. An analysis of the SDSS optical spectra of VCC322 indicates mass- and light-weighted ages of about 10$^{9.8}$ yr and 10$^{7.5}$ yr, respectively, indicating an ongoing star formation activity. However, the star formation in VCC322 seems suppressed when compared to other star-forming dwarfs of comparable stellar masses. Our finding of shock excitation of optical emission lines indicates that interaction-induced shock may contribute to the heating of cold gas and suppression of star formation.


title: Theory of collective excitations in the quadruple-$Q$ magnetic hedgehog lattices

abstract: Hedgehog and antihedgehog spin textures in magnets behave as emergent monopoles and antimonopoles, which give rise to astonishing transport and electromagnetic phenomena. Using the Kondo-lattice model in three dimensions, we theoretically study collective spin-wave excitation modes of magnetic hedgehog lattices which have recently been discovered in itinerant magnets such as MnSi1-xGex and SrFeO3. It is revealed that the spin-wave modes, which appear in the sub-terahertz regime, have dominant amplitudes localized at Dirac strings connecting hedgehog-antihedgehog pairs and are characterized by their translational oscillations. It is found that their spectral features sensitively depend on the number and configuration of the Dirac strings and, thus, can be exploited for identifying the topological phase transitions associated with the monopole-antimonopole pair annihilations.


title: Improving Visual Perception of a Social Robot for Controlled and In-the-wild Human-robot Interaction

abstract: Social robots often rely on visual perception to understand their users and the environment. Recent advancements in data-driven approaches for computer vision have demonstrated great potentials for applying deep-learning models to enhance a social robot's visual perception. However, the high computational demands of deep-learning methods, as opposed to the more resource-efficient shallow-learning models, bring up important questions regarding their effects on real-world interaction and user experience. It is unclear how will the objective interaction performance and subjective user experience be influenced when a social robot adopts a deep-learning based visual perception model. We employed state-of-the-art human perception and tracking models to improve the visual perception function of the Pepper robot and conducted a controlled lab study and an in-the-wild human-robot interaction study to evaluate this novel perception function for following a specific user with other people present in the scene.


title: KeNet:Knowledge-enhanced Doc-Label Attention Network for Multi-label text classification

abstract: Multi-Label Text Classification (MLTC) is a fundamental task in the field of Natural Language Processing (NLP) that involves the assignment of multiple labels to a given text. MLTC has gained significant importance and has been widely applied in various domains such as topic recognition, recommendation systems, sentiment analysis, and information retrieval. However, traditional machine learning and Deep neural network have not yet addressed certain issues, such as the fact that some documents are brief but have a large number of labels and how to establish relationships between the labels. It is imperative to additionally acknowledge that the significance of knowledge is substantiated in the realm of MLTC. To address this issue, we provide a novel approach known as Knowledge-enhanced Doc-Label Attention Network (KeNet). Specifically, we design an Attention Network that incorporates external knowledge, label embedding, and a comprehensive attention mechanism. In contrast to conventional methods, we use comprehensive representation of documents, knowledge and labels to predict all labels for each single text. Our approach has been validated by comprehensive research conducted on three multi-label datasets. Experimental results demonstrate that our method outperforms state-of-the-art MLTC method. Additionally, a case study is undertaken to illustrate the practical implementation of KeNet.


title: Canonical Form of Datatic Description in Control Systems

abstract: The design of feedback controllers is undergoing a paradigm shift from modelic (i.e., model-driven) control to datatic (i.e., data-driven) control. Canonical form of state space model is an important concept in modelic control systems, exemplified by Jordan form, controllable form and observable form, whose purpose is to facilitate system analysis and controller synthesis. In the realm of datatic control, there is a notable absence in the standardization of data-based system representation. This paper for the first time introduces the concept of canonical data form for the purpose of achieving more effective design of datatic controllers. In a control system, the data sample in canonical form consists of a transition component and an attribute component. The former encapsulates the plant dynamics at the sampling time independently, which is a tuple containing three elements: a state, an action and their corresponding next state. The latter describes one or some artificial characteristics of the current sample, whose calculation must be performed in an online manner. The attribute of each sample must adhere to two requirements: (1) causality, ensuring independence from any future samples; and (2) locality, allowing dependence on historical samples but constrained to a finite neighboring set. The purpose of adding attribute is to offer some kinds of benefits for controller design in terms of effectiveness and efficiency. To provide a more close-up illustration, we present two canonical data forms: temporal form and spatial form, and demonstrate their advantages in reducing instability and enhancing training efficiency in two datatic control systems.


title: A Safe Screening Rule with Bi-level Optimization of $\nu$ Support Vector Machine

abstract: Support vector machine (SVM) has achieved many successes in machine learning, especially for a small sample problem. As a famous extension of the traditional SVM, the $\nu$ support vector machine ($\nu$-SVM) has shown outstanding performance due to its great model interpretability. However, it still faces challenges in training overhead for large-scale problems. To address this issue, we propose a safe screening rule with bi-level optimization for $\nu$-SVM (SRBO-$\nu$-SVM) which can screen out inactive samples before training and reduce the computational cost without sacrificing the prediction accuracy. Our SRBO-$\nu$-SVM is strictly deduced by integrating the Karush-Kuhn-Tucker (KKT) conditions, the variational inequalities of convex problems and the $\nu$-property. Furthermore, we develop an efficient dual coordinate descent method (DCDM) to further improve computational speed. Finally, a unified framework for SRBO is proposed to accelerate many SVM-type models, and it is successfully applied to one-class SVM. Experimental results on 6 artificial data sets and 30 benchmark data sets have verified the effectiveness and safety of our proposed methods in supervised and unsupervised tasks.


title: Experimenting with Generative AI: Does ChatGPT Really Increase Everyone's Productivity?

abstract: Generative AI technologies such as ChatGPT, Gemini, and MidJourney have made remarkable progress in recent years. Recent literature has documented ChatGPT's positive impact on productivity in areas where it has strong expertise, attributable to extensive training datasets, such as the English language and Python/SQL programming. However, there is still limited literature regarding ChatGPT's performance in areas where its capabilities could still be further enhanced. This paper aims to fill this gap. We conducted an experiment in which economics students were asked to perform writing analysis tasks in a non-English language (specifically, Thai) and math & data analysis tasks using a less frequently used programming package (specifically, Stata). The findings suggest that, on average, participants performed better using ChatGPT in terms of scores and time taken to complete the tasks. However, a detailed examination reveals that 34% of participants saw no improvement in writing analysis tasks, and 42% did not improve in math & data analysis tasks when employing ChatGPT. Further investigation indicated that higher-ability students, as proxied by their econometrics grades, were the ones who performed worse in writing analysis tasks when using ChatGPT. We also found evidence that students with better digital skills performed better with ChatGPT. This research provides insights on the impact of generative AI. Thus, stakeholders can make informed decisions to implement appropriate policy frameworks or redesign educational systems. It also highlights the critical role of human skills in addressing and complementing the limitations of technology.


title: Weakly modular graphs with diamond condition, the interval function and axiomatic characterizations

abstract: Weakly modular graphs are defined as the class of graphs that satisfy the \emph{triangle condition ($TC$)} and the \emph{quadrangle condition ($QC$)}. We study an interesting subclass of weakly modular graphs that satisfies a stronger version of the triangle condition, known as the \emph{triangle diamond condition ($TDC$)}. and term this subclass of weakly modular graphs as the \emph{diamond-weakly modular graphs}. It is observed that this class contains the class of bridged graphs and the class of weakly bridged graphs. The interval function $I_G$ of a connected graph $G$ with vertex set $V$ is an important concept in metric graph theory and is one of the prime example of a transit function; a set function defined on the Cartesian product $V\times V$ to the power set of $V$ satisfying the expansive, symmetric and idempotent axioms. In this paper, we derive an interesting axiom denoted as $(J0')$, obtained from a well-known axiom introduced by Marlow Sholander in 1952, denoted as $(J0)$. It is proved that the axiom $(J0')$ is a characterizing axiom of the diamond-weakly modular graphs. We propose certain types of independent first-order betweenness axioms on an arbitrary transit function $R$ and prove that an arbitrary transit function becomes the interval function of a diamond-weakly modular graph if and only if $R$ satisfies these betweenness axioms. Similar characterizations are obtained for the interval function of bridged graphs and weakly bridged graphs.


title: A Simple and Accurate Method for Computing Optimized Effective Potentials for Exact Exchange Energy

abstract: The inverse Kohn-Sham density-functional theory (inv-KS) for the electron density of the Hartree-Fock (HF) wave function was revisited within the context of the optimized effective potential (HF- OEP). First, it is proved that the exchange potential created by the inv-KS is equivalent to the potential obtained by the HF-OEP when the HF-OEP realizes the HF energy of the system under consideration. Next the real-space grid (RSG) implementations of the inv-KS and the HF-OEP are addressed. The total HF energies EHF for the wave functions on the effective potentials optimized by the inv-KS are computed for a set of small molecules. It is found that the mean absolute deviation (MAD) of EHF from the HF energy is clearly smaller than the MAD of EHF, demonstrating that the inv-KS is advantageous in constructing the detailed structure of the exchange potential vx as compared with the HF-OEP. The inv-KS method is also applied to an ortho-benzyne radical known as a strongly correlated polyatomic molecule. It is revealed that the spin populations on the atomic sites computed by the UHF calculation can be faithfully reproduced by the wave functions on the inv-KS potential.


title: Improving out-of-distribution generalization in graphs via hierarchical semantic environments

abstract: Out-of-distribution (OOD) generalization in the graph domain is challenging due to complex distribution shifts and a lack of environmental contexts. Recent methods attempt to enhance graph OOD generalization by generating flat environments. However, such flat environments come with inherent limitations to capture more complex data distributions. Considering the DrugOOD dataset, which contains diverse training environments (e.g., scaffold, size, etc.), flat contexts cannot sufficiently address its high heterogeneity. Thus, a new challenge is posed to generate more semantically enriched environments to enhance graph invariant learning for handling distribution shifts. In this paper, we propose a novel approach to generate hierarchical semantic environments for each graph. Firstly, given an input graph, we explicitly extract variant subgraphs from the input graph to generate proxy predictions on local environments. Then, stochastic attention mechanisms are employed to re-extract the subgraphs for regenerating global environments in a hierarchical manner. In addition, we introduce a new learning objective that guides our model to learn the diversity of environments within the same hierarchy while maintaining consistency across different hierarchies. This approach enables our model to consider the relationships between environments and facilitates robust graph invariant learning. Extensive experiments on real-world graph data have demonstrated the effectiveness of our framework. Particularly, in the challenging dataset DrugOOD, our method achieves up to 1.29% and 2.83% improvement over the best baselines on IC50 and EC50 prediction tasks, respectively.


title: WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citations

abstract: Enhancing the attribution in large language models (LLMs) is a crucial task. One feasible approach is to enable LLMs to cite external sources that support their generations. However, existing datasets and evaluation methods in this domain still exhibit notable limitations. In this work, we formulate the task of attributed query-focused summarization (AQFS) and present WebCiteS, a Chinese dataset featuring 7k human-annotated summaries with citations. WebCiteS derives from real-world user queries and web search results, offering a valuable resource for model training and evaluation. Prior works in attribution evaluation do not differentiate between groundedness errors and citation errors. They also fall short in automatically verifying sentences that draw partial support from multiple sources. We tackle these issues by developing detailed metrics and enabling the automatic evaluator to decompose the sentences into sub-claims for fine-grained verification. Our comprehensive evaluation of both open-source and proprietary models on WebCiteS highlights the challenge LLMs face in correctly citing sources, underscoring the necessity for further improvement. The dataset and code will be open-sourced to facilitate further research in this crucial field.


abstract: One of the open challenges in quantum computing is to find meaningful and practical methods to leverage quantum computation to accelerate classical machine learning workflows. A ubiquitous problem in machine learning workflows is sampling from probability distributions that we only have access to via their log probability. To this end, we extend the well-known Hamiltonian Monte Carlo (HMC) method for Markov Chain Monte Carlo (MCMC) sampling to leverage quantum computation in a hybrid manner as a proposal function. Our new algorithm, Quantum Dynamical Hamiltonian Monte Carlo (QD-HMC), replaces the classical symplectic integration proposal step with simulations of quantum-coherent continuous-space dynamics on digital or analogue quantum computers. We show that QD-HMC maintains key characteristics of HMC, such as maintaining the detailed balanced condition with momentum inversion, while also having the potential for polynomial speedups over its classical counterpart in certain scenarios. As sampling is a core subroutine in many forms of probabilistic inference, and MCMC in continuously-parameterized spaces covers a large-class of potential applications, this work widens the areas of applicability of quantum devices.


title: Hybrid data-driven and physics-informed regularized learning of cyclic plasticity with Neural Networks

abstract: An extendable, efficient and explainable Machine Learning approach is proposed to represent cyclic plasticity and replace conventional material models based on the Radial Return Mapping algorithm. High accuracy and stability by means of a limited amount of training data is achieved by implementing physics-informed regularizations and the back stress information. The off-loading of the Neural Network is applied to the maximal extent. The proposed model architecture is simpler and more efficient compared to existing solutions from the literature, while representing a complete three-dimensional material model. The validation of the approach is carried out by means of surrogate data obtained with the Armstrong-Frederick kinematic hardening model. The Mean Squared Error is assumed as the loss function which stipulates several restrictions: deviatoric character of internal variables, compliance with the flow rule, the differentiation of elastic and plastic steps and the associativity of the flow rule. The latter, however, has a minor impact on the accuracy, which implies the generalizability of the model for a broad spectrum of evolution laws for internal variables. Numerical tests simulating several load cases are shown in detail and validated for accuracy and stability.

categories: cond-mat.mtrl-sci cs.LG nlin.AO physics.comp-ph


title: NPHardEval4V: A Dynamic Reasoning Benchmark of Multimodal Large Language Models

abstract: Understanding the reasoning capabilities of Multimodal Large Language Models (MLLMs) is an important area of research. In this study, we introduce a dynamic benchmark, NPHardEval4V, aimed at addressing the existing gaps in evaluating the pure reasoning abilities of MLLMs. Our benchmark aims to provide a venue to disentangle the effect of various factors such as image recognition and instruction following, from the overall performance of the models, allowing us to focus solely on evaluating their reasoning abilities. It is built by converting textual description of questions from NPHardEval to image representations. Our findings reveal significant discrepancies in reasoning abilities across different models and highlight the relatively weak performance of MLLMs compared to LLMs in terms of reasoning. We also investigate the impact of different prompting styles, including visual, text, and combined visual and text prompts, on the reasoning abilities of MLLMs, demonstrating the different impacts of multimodal inputs in model performance. Unlike traditional benchmarks, which focus primarily on static evaluations, our benchmark will be updated monthly to prevent overfitting and ensure a more authentic and fine-grained evaluation of the models. We believe that this benchmark can aid in understanding and guide the further development of reasoning abilities in MLLMs. The benchmark dataset and code are available at https://github.com/lizhouf/NPHardEval4V


title: HOSCF: Efficient decoupling algorithms for finding the best rank-one approximation of higher-order tensors

abstract: Best rank-one approximation is one of the most fundamental tasks in tensor computation. In order to fully exploit modern multi-core parallel computers, it is necessary to develop decoupling algorithms for computing the best rank-one approximation of higher-order tensors at large scales. In this paper, we first build a bridge between the rank-one approximation of tensors and the eigenvector-dependent nonlinear eigenvalue problem (NEPv), and then develop an efficient decoupling algorithm, namely the higher-order self-consistent field (HOSCF) algorithm, inspired by the famous self-consistent field (SCF) iteration frequently used in computational chemistry. The convergence theory of the HOSCF algorithm and an estimation of the convergence speed are further presented. In addition, we propose an improved HOSCF (iHOSCF) algorithm that incorporates the Rayleigh quotient iteration, which can significantly accelerate the convergence of HOSCF. Numerical experiments show that the proposed algorithms can efficiently converge to the best rank-one approximation of both synthetic and real-world tensors and can scale with high parallel scalability on a modern parallel computer.


title: OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on

abstract: We present OOTDiffusion, a novel network architecture for realistic and controllable image-based virtual try-on (VTON). We leverage the power of pretrained latent diffusion models, designing an outfitting UNet to learn the garment detail features. Without a redundant warping process, the garment features are precisely aligned with the target human body via the proposed outfitting fusion in the self-attention layers of the denoising UNet. In order to further enhance the controllability, we introduce outfitting dropout to the training process, which enables us to adjust the strength of the garment features through classifier-free guidance. Our comprehensive experiments on the VITON-HD and Dress Code datasets demonstrate that OOTDiffusion efficiently generates high-quality try-on results for arbitrary human and garment images, which outperforms other VTON methods in both realism and controllability, indicating an impressive breakthrough in virtual try-on. Our source code is available at https://github.com/levihsu/OOTDiffusion.


title: Graph neural network for in-network placement of real-time metaverse tasks in next-generation network

abstract: This study addresses the challenge of real-time metaverse applications by proposing an in-network placement and task-offloading solution for delay-constrained computing tasks in next-generation networks. The metaverse, envisioned as a parallel virtual world, requires seamless real-time experiences across diverse applications. The study introduces a software-defined networking (SDN)-based architecture and employs graph neural network (GNN) techniques for intelligent and adaptive task allocation in in-network computing (INC). Considering time constraints and computing capabilities, the proposed model optimally decides whether to offload rendering tasks to INC nodes or edge server. Extensive experiments demonstrate the superior performance of the proposed GNN model, achieving 97% accuracy compared to 72% for multilayer perceptron (MLP) and 70% for decision trees (DTs). The study fills the research gap in in-network placement for real-time metaverse applications, offering insights into efficient rendering task handling.


title: Integrating Efficient Optimal Transport and Functional Maps For Unsupervised Shape Correspondence Learning

abstract: In the realm of computer vision and graphics, accurately establishing correspondences between geometric 3D shapes is pivotal for applications like object tracking, registration, texture transfer, and statistical shape analysis. Moving beyond traditional hand-crafted and data-driven feature learning methods, we incorporate spectral methods with deep learning, focusing on functional maps (FMs) and optimal transport (OT). Traditional OT-based approaches, often reliant on entropy regularization OT in learning-based framework, face computational challenges due to their quadratic cost. Our key contribution is to employ the sliced Wasserstein distance (SWD) for OT, which is a valid fast optimal transport metric in an unsupervised shape matching framework. This unsupervised framework integrates functional map regularizers with a novel OT-based loss derived from SWD, enhancing feature alignment between shapes treated as discrete probability measures. We also introduce an adaptive refinement process utilizing entropy regularized OT, further refining feature alignments for accurate point-to-point correspondences. Our method demonstrates superior performance in non-rigid shape matching, including near-isometric and non-isometric scenarios, and excels in downstream tasks like segmentation transfer. The empirical results on diverse datasets highlight our framework's effectiveness and generalization capabilities, setting new standards in non-rigid shape matching with efficient OT metrics and an adaptive refinement module.


title: Tuning and Testing an Online Feedback Optimization Controller to Provide Curative Distribution Grid Flexibility

abstract: Due to more volatile generation, flexibility will become more important in transmission grids. One potential source of this flexibility can be distribution grids. A flexibility request from the transmission grid to a distribution grid then needs to be split up onto the different flexibility providing units (FPU) in the distribution grid. One potential way to do this is Online Feedback Optimization (OFO). OFO is a new control method that steers power systems to the optimal solution of an optimization problem using minimal model information and computation power. This paper will show how to choose the optimization problem and how to tune the OFO controller. Afterward, we test the resulting controller on a real distribution grid laboratory and show its performance, its interaction with other controllers in the grid, and how it copes with disturbances. Overall, the paper makes a clear recommendation on how to phrase the optimization problem and tune the OFO controller. Furthermore, it experimentally verifies that an OFO controller is a powerful tool to disaggregate flexibility requests onto FPUs while satisfying operational constraints inside the flexibility providing distribution grid.


title: Towards A Diffractive Analysis of Prompt-Based Generative AI

abstract: Recent developments in prompt-based generative AI has given rise to discourse surrounding the perceived ethical concerns, economic implications, and consequences for the future of cultural production. As generative imagery becomes pervasive in mainstream society, dominated primarily by emerging industry leaders, we encourage that the role of the CHI community be one of inquiry; to investigate the numerous ways in which generative AI has the potential to, and already is, augmenting human creativity. In this paper, we conducted a diffractive analysis exploring the potential role of prompt-based interfaces in artists' creative practice. Over a two week period, seven visual artists were given access to a personalised instance of Stable Diffusion, fine-tuned on a dataset of their work. In the following diffractive analysis, we identified two dominant modes adopted by participants, AI for ideation, and AI for production. We furthermore present a number of ethical design considerations for the future development of generative AI interfaces.


title: CatCode: A Comprehensive Evaluation Framework for LLMs On the Mixture of Code and Text

abstract: Large language models (LLMs) such as ChatGPT are increasingly proficient in understanding and generating a mixture of code and text. Evaluation based on such $\textit{mixture}$ can lead to a more comprehensive understanding of the models' abilities in solving coding problems. However, in this context, current evaluation methods are either limited in task coverage or lack standardization. To address this issue, we propose using category theory as a framework for evaluation. Specifically, morphisms within a code category can represent code debugging and transformation, functors between two categories represent code translation, and functors between a code category and a natural language category represent code generation, explanation, and reproduction. We present an automatic evaluation framework called $\textbf{CatCode}$ ($\textbf{Cat}$egory $\textbf{Code}$) that can comprehensively assess the coding abilities of LLMs, including ChatGPT, Text-Davinci, and CodeGeeX.


title: What do neural networks listen to? Exploring the crucial bands in Speech Enhancement using Sinc-convolution

abstract: This study introduces a reformed Sinc-convolution (Sincconv) framework tailored for the encoder component of deep networks for speech enhancement (SE). The reformed Sincconv, based on parametrized sinc functions as band-pass filters, offers notable advantages in terms of training efficiency, filter diversity, and interpretability. The reformed Sinc-conv is evaluated in conjunction with various SE models, showcasing its ability to boost SE performance. Furthermore, the reformed Sincconv provides valuable insights into the specific frequency components that are prioritized in an SE scenario. This opens up a new direction of SE research and improving our knowledge of their operating dynamics.


title: Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detection

abstract: Deepfake technology has given rise to a spectrum of novel and compelling applications. Unfortunately, the widespread proliferation of high-fidelity fake videos has led to pervasive confusion and deception, shattering our faith that seeing is believing. One aspect that has been overlooked so far is that current deepfake detection approaches may easily fall into the trap of overfitting, focusing only on forgery clues within one or a few local regions. Moreover, existing works heavily rely on neural networks to extract forgery features, lacking theoretical constraints guaranteeing that sufficient forgery clues are extracted and superfluous features are eliminated. These deficiencies culminate in unsatisfactory accuracy and limited generalizability in real-life scenarios. In this paper, we try to tackle these challenges through three designs: (1) We present a novel framework to capture broader forgery clues by extracting multiple non-overlapping local representations and fusing them into a global semantic-rich feature. (2) Based on the information bottleneck theory, we derive Local Information Loss to guarantee the orthogonality of local representations while preserving comprehensive task-relevant information. (3) Further, to fuse the local representations and remove task-irrelevant information, we arrive at a Global Information Loss through the theoretical analysis of mutual information. Empirically, our method achieves state-of-the-art performance on five benchmark datasets.Our code is available at \url{https://github.com/QingyuLiu/Exposing-the-Deception}, hoping to inspire researchers.


title: Effective Weak Universality in Short Intervals

abstract: We prove an effective universality theorem of the Riemann zeta-function in short intervals $[T,T+H]$ with $T^{\frac{27}{82}}\le H\le T$ by following an effective multidimensional $\Omega$-result of Voronin. Furthermore, we also prove the results in short intervals $[T,T+H]$ with $T^\epsilon\le H\le T$ (for any fixed $\epsilon>0$) under the assumption of the Riemann Hypothesis.


title: K-stars LDP: A Novel Framework for (p, q)-clique Enumeration under Local Differential Privacy

abstract: (p,q)-clique enumeration on a bipartite graph is critical for calculating clustering coefficient and detecting densest subgraph. It is necessary to carry out subgraph enumeration while protecting users' privacy from any potential attacker as the count of subgraph may contain sensitive information. Most recent studies focus on the privacy protection algorithms based on edge LDP (Local Differential Privacy). However, these algorithms suffer a large estimation error due to the great amount of required noise. In this paper, we propose a novel idea of k-stars LDP and a novel k-stars LDP algorithm for (p, q)-clique enumeration with a small estimation error, where a k-stars is a star-shaped graph with k nodes connecting to one node. The effectiveness of edge LDP relies on its capacity to obfuscate the existence of an edge between the user and his one-hop neighbors. This is based on the premise that a user should be aware of the existence of his one-hop neighbors. Similarly, we can apply this premise to k-stars as well, where an edge is a specific genre of 1-stars. Based on this fact, we first propose the k-stars neighboring list to enable our algorithm to obfuscate the existence of k-stars with Warner' s RR. Then, we propose the absolute value correction technique and the k-stars sampling technique to further reduce the estimation error. Finally, with the two-round user-collector interaction mechanism, we propose our k-stars LDP algorithm to count the number of (p, q)-clique while successfully protecting users' privacy. Both the theoretical analysis and experiments have showed the superiority of our algorithm over the algorithms based on edge LDP.


title: DECOR: Enhancing Logic Locking Against Machine Learning-Based Attacks

abstract: Logic locking (LL) has gained attention as a promising intellectual property protection measure for integrated circuits. However, recent attacks, facilitated by machine learning (ML), have shown the potential to predict the correct key in multiple LL schemes by exploiting the correlation of the correct key value with the circuit structure. This paper presents a generic LL enhancement method based on a randomized algorithm that can significantly decrease the correlation between locked circuit netlist and correct key values in an LL scheme. Numerical results show that the proposed method can efficiently degrade the accuracy of state-of-the-art ML-based attacks down to around 50%, resulting in negligible advantage versus random guessing.


title: Characterisation of the stellar activity of M dwarfs. II. Relationship between Ca, H$\alpha$, and Na chromospheric emissions

abstract: The chromospheric emission estimated in the core of different lines, such as Ca II H & K, Na D1 and D2, and Halpha, is not always correlated between lines, as the Ca II H & K and Halpha emission time series are anti-correlated for a few percent of the stars, contrary to what is observed on the Sun. This puzzling result has been observed for both solar-type and M stars. Our objective is to characterise these relationships in more detail using complementary criteria, based on a set of spectra obtained with HARPS for a large sample of M dwarfs, to evaluate whether or not additional processes are required to explain the observations. We analysed the time average and variability of the Ca, Na, and Halpha emissions for 177 M0-M8 stars. We computed synthetic Halpha time series based on different assumptions of plage properties. The statistical properties of our sample, in terms of correlations and slopes between indices at different timescales, differ from what we previously obtained for FGK stars, with fewer stars with a null correlation, and a weaker dependence of the correlations on timescale. However, there can be a large dispersion from one season to another for stars. We find a clear indication of a change in the slope sign from the relation between averaged Ca (or Na) and Halpha for the most massive M dwarfs, as well as a change in slope in the Na-Ca relation. At this stage, we are not able to find simple plage properties that, alone, are sufficient to reproduce the observations. Simulations shows that it is not straightforward to compare the temporal variability correlation and the integrated indices and demonstrate the need for complex activity patterns to explain some of the observations. We conclude that the relation between these indices exhibits a large diversity in behaviour. More detailed simulations with complex activity patterns are necessary to understand these observations.


title: Beyond Recommender: An Exploratory Study of the Effects of Different AI Roles in AI-Assisted Decision Making

abstract: Artificial Intelligence (AI) is increasingly employed in various decision-making tasks, typically as a Recommender, providing recommendations that the AI deems correct. However, recent studies suggest this may diminish human analytical thinking and lead to humans' inappropriate reliance on AI, impairing the synergy in human-AI teams. In contrast, human advisors in group decision-making perform various roles, such as analyzing alternative options or criticizing decision-makers to encourage their critical thinking. This diversity of roles has not yet been empirically explored in AI assistance. In this paper, we examine three AI roles: Recommender, Analyzer, and Devil's Advocate, and evaluate their effects across two AI performance levels. Our results show each role's distinct strengths and limitations in task performance, reliance appropriateness, and user experience. Notably, the Recommender role is not always the most effective, especially if the AI performance level is low, the Analyzer role may be preferable. These insights offer valuable implications for designing AI assistants with adaptive functional roles according to different situations.


title: ConSep: a Noise- and Reverberation-Robust Speech Separation Framework by Magnitude Conditioning

abstract: Speech separation has recently made significant progress thanks to the fine-grained vision used in time-domain methods. However, several studies have shown that adopting Short-Time Fourier Transform (STFT) for feature extraction could be beneficial when encountering harsher conditions, such as noise or reverberation. Therefore, we propose a magnitude-conditioned time-domain framework, ConSep, to inherit the beneficial characteristics. The experiment shows that ConSep promotes performance in anechoic, noisy, and reverberant settings compared to two celebrated methods, SepFormer and Bi-Sep. Furthermore, we visualize the components of ConSep to strengthen the advantages and cohere with the actualities we have found in preliminary studies.


title: Isospin-forbidden electric dipole transition of the 9.64 MeV state of $^{12}$C

abstract: The electric dipole transition of the 3$^-$ state at 9.64 MeV of $^{12}$C to the 2$^+$ state at 4.44 MeV is speculated to play a key role in the triple-$\alpha$ reaction at high temperatures. A theoretical prediction of its transition width is a challenge to nuclear theory because it belongs to a class of isospin-forbidden transitions. We extend a microscopic 3$\alpha$ cluster-model to include isospin 1 impurity components, and take into account both isovector and isoscalar electirc dipole operators. Several sets of $2^+$ and $3^-$ wave functions are generated by solving a radius-constrained equation of motion with the stochastic variational method, resulting in reproducing very well the electric quadrupole and octupole transition probabilities to the ground state. The electric dipole transition width is found to be 7--31 meV, 16 meV on the average, and more than half of the width is contributed by the isospin mixing of $\alpha$ particles.


title: Twisted hyperbolic van der Waals crystals for full Stokes mid-infrared polarization detection

abstract: Investigating the polarization properties of light in the mid-infrared (mid-IR) spectrum is crucial for molecular sensing, biomedical diagnostics, and IR imaging system technologies. Traditional methods, limited by bulky size and intricate fabrication, utilize large rotating optics for full Stokes polarization detection, impeding miniaturization and accuracy. Van der Waals materials (vdW) based devices can address these challenges due to their lithography-free fabrication, ease of integration with chip-scale platforms and room-temperature operation. This study introduces a chip-integrated polarimeter device leveraging the in-plane biaxial hyperbolic vdW crystal properties for mid-infrared light manipulation. The spatial division measurement scheme incorporates six meticulously designed linear and circular polarization filters, achieving high extinction ratios exceeding 30 dB and transmittance surpassing 50%, with fabrication tolerance of film thickness up to 100 nm. The proposed device represents a significant advancement in polarimetric detection, providing a compact, cost-effective solution and opens new avenues for on-chip mid-IR polarimetric detection in next-generation ultra-compact optical systems.


title: RankED: Addressing Imbalance and Uncertainty in Edge Detection Using Ranking-based Losses

abstract: Detecting edges in images suffers from the problems of (P1) heavy imbalance between positive and negative classes as well as (P2) label uncertainty owing to disagreement between different annotators. Existing solutions address P1 using class-balanced cross-entropy loss and dice loss and P2 by only predicting edges agreed upon by most annotators. In this paper, we propose RankED, a unified ranking-based approach that addresses both the imbalance problem (P1) and the uncertainty problem (P2). RankED tackles these two problems with two components: One component which ranks positive pixels over negative pixels, and the second which promotes high confidence edge pixels to have more label certainty. We show that RankED outperforms previous studies and sets a new state-of-the-art on NYUD-v2, BSDS500 and Multi-cue datasets. Code is available at https://ranked-cvpr24.github.io.


title: Hydrogen is not necessary for superconductivity in topotactically reduced nickelates

abstract: A key open question in the study of layered superconducting nickelate films is the role that hydrogen incorporation into the lattice plays in the appearance of the superconducting state. Due to the challenges of stabilizing highly crystalline square planar nickelate films, films are prepared by the deposition of a more stable parent compound which is then transformed into the target phase via a topotactic reaction with a strongly reducing agent such as CaH$_2$. Recent studies, both experimental and theoretical, have introduced the possibility that the incorporation of hydrogen from the reducing agent into the nickelate lattice may be critical for the superconductivity. In this work, we use secondary ion mass spectrometry to examine superconducting La$_{1-x}$X$_x$NiO$_2$ / SrTiO$_3$ (X = Ca and Sr) and Nd$_6$Ni$_5$O$_{12}$ / NdGaO$_3$ films, along with non-superconducting NdNiO$_2$ / SrTiO$_3$ and (Nd,Sr)NiO$_2$ / SrTiO$_3$. We find no evidence for extensive hydrogen incorporation across a broad range of samples, including both superconducting and non-superconducting films. Theoretical calculations indicate that hydrogen incorporation is broadly energetically unfavorable in these systems, supporting our conclusion that hydrogen incorporation is not generally required to achieve a superconducting state in layered square-planar nickelates.


title: Unleashing Graph Partitioning for Large-Scale Nearest Neighbor Search

abstract: We consider the fundamental problem of decomposing a large-scale approximate nearest neighbor search (ANNS) problem into smaller sub-problems. The goal is to partition the input points into neighborhood-preserving shards, so that the nearest neighbors of any point are contained in only a few shards. When a query arrives, a routing algorithm is used to identify the shards which should be searched for its nearest neighbors. This approach forms the backbone of distributed ANNS, where the dataset is so large that it must be split across multiple machines. In this paper, we design simple and highly efficient routing methods, and prove strong theoretical guarantees on their performance. A crucial characteristic of our routing algorithms is that they are inherently modular, and can be used with any partitioning method. This addresses a key drawback of prior approaches, where the routing algorithms are inextricably linked to their associated partitioning method. In particular, our new routing methods enable the use of balanced graph partitioning, which is a high-quality partitioning method without a naturally associated routing algorithm. Thus, we provide the first methods for routing using balanced graph partitioning that are extremely fast to train, admit low latency, and achieve high recall. We provide a comprehensive evaluation of our full partitioning and routing pipeline on billion-scale datasets, where it outperforms existing scalable partitioning methods by significant margins, achieving up to 2.14x higher QPS at 90% recall$@10$ than the best competitor.


title: Towards Fair and Efficient Learning-based Congestion Control

abstract: Recent years have witnessed a plethora of learning-based solutions for congestion control (CC) that demonstrate better performance over traditional TCP schemes. However, they fail to provide consistently good convergence properties, including {\em fairness}, {\em fast convergence} and {\em stability}, due to the mismatch between their objective functions and these properties. Despite being intuitive, integrating these properties into existing learning-based CC is challenging, because: 1) their training environments are designed for the performance optimization of single flow but incapable of cooperative multi-flow optimization, and 2) there is no directly measurable metric to represent these properties into the training objective function. We present Astraea, a new learning-based congestion control that ensures fast convergence to fairness with stability. At the heart of Astraea is a multi-agent deep reinforcement learning framework that explicitly optimizes these convergence properties during the training process by enabling the learning of interactive policy between multiple competing flows, while maintaining high performance. We further build a faithful multi-flow environment that emulates the competing behaviors of concurrent flows, explicitly expressing convergence properties to enable their optimization during training. We have fully implemented Astraea and our comprehensive experiments show that Astraea can quickly converge to fairness point and exhibit better stability than its counterparts. For example, \sys achieves near-optimal bandwidth sharing (i.e., fairness) when multiple flows compete for the same bottleneck, delivers up to 8.4$\times$ faster convergence speed and 2.8$\times$ smaller throughput deviation, while achieving comparable or even better performance over prior solutions.


title: Superpixel Graph Contrastive Clustering with Semantic-Invariant Augmentations for Hyperspectral Images

abstract: Hyperspectral images (HSI) clustering is an important but challenging task. The state-of-the-art (SOTA) methods usually rely on superpixels, however, they do not fully utilize the spatial and spectral information in HSI 3-D structure, and their optimization targets are not clustering-oriented. In this work, we first use 3-D and 2-D hybrid convolutional neural networks to extract the high-order spatial and spectral features of HSI through pre-training, and then design a superpixel graph contrastive clustering (SPGCC) model to learn discriminative superpixel representations. Reasonable augmented views are crucial for contrastive clustering, and conventional contrastive learning may hurt the cluster structure since different samples are pushed away in the embedding space even if they belong to the same class. In SPGCC, we design two semantic-invariant data augmentations for HSI superpixels: pixel sampling augmentation and model weight augmentation. Then sample-level alignment and clustering-center-level contrast are performed for better intra-class similarity and inter-class dissimilarity of superpixel embeddings. We perform clustering and network optimization alternatively. Experimental results on several HSI datasets verify the advantages of the proposed method, e.g., on India Pines, our model improves the clustering accuracy from 58.79% to 67.59% compared to the SOTA method.


title: AtomoVideo: High Fidelity Image-to-Video Generation

abstract: Recently, video generation has achieved significant rapid development based on superior text-to-image generation techniques. In this work, we propose a high fidelity framework for image-to-video generation, named AtomoVideo. Based on multi-granularity image injection, we achieve higher fidelity of the generated video to the given image. In addition, thanks to high quality datasets and training strategies, we achieve greater motion intensity while maintaining superior temporal consistency and stability. Our architecture extends flexibly to the video frame prediction task, enabling long sequence prediction through iterative generation. Furthermore, due to the design of adapter training, our approach can be well combined with existing personalized models and controllable modules. By quantitatively and qualitatively evaluation, AtomoVideo achieves superior results compared to popular methods, more examples can be found on our project website: https://atomo-video.github.io/.


title: COLA: Cross-city Mobility Transformer for Human Trajectory Simulation

abstract: Human trajectory data produced by daily mobile devices has proven its usefulness in various substantial fields such as urban planning and epidemic prevention. In terms of the individual privacy concern, human trajectory simulation has attracted increasing attention from researchers, targeting at offering numerous realistic mobility data for downstream tasks. Nevertheless, the prevalent issue of data scarcity undoubtedly degrades the reliability of existing deep learning models. In this paper, we are motivated to explore the intriguing problem of mobility transfer across cities, grasping the universal patterns of human trajectories to augment the powerful Transformer with external mobility data. There are two crucial challenges arising in the knowledge transfer across cities: 1) how to transfer the Transformer to adapt for domain heterogeneity; 2) how to calibrate the Transformer to adapt for subtly different long-tail frequency distributions of locations. To address these challenges, we have tailored a Cross-city mObiLity trAnsformer (COLA) with a dedicated model-agnostic transfer framework by effectively transferring cross-city knowledge for human trajectory simulation. Firstly, COLA divides the Transformer into the private modules for city-specific characteristics and the shared modules for city-universal mobility patterns. Secondly, COLA leverages a lightweight yet effective post-hoc adjustment strategy for trajectory simulation, without disturbing the complex bi-level optimization of model-agnostic knowledge transfer. Extensive experiments of COLA compared to state-of-the-art single-city baselines and our implemented cross-city baselines have demonstrated its superiority and effectiveness. The code is available at https://github.com/Star607/Cross-city-Mobility-Transformer.


title: TNF: Tri-branch Neural Fusion for Multimodal Medical Data Classification

abstract: This paper presents a Tri-branch Neural Fusion (TNF) approach designed for classifying multimodal medical images and tabular data. It also introduces two solutions to address the challenge of label inconsistency in multimodal classification. Traditional methods in multi-modality medical data classification often rely on single-label approaches, typically merging features from two distinct input modalities. This becomes problematic when features are mutually exclusive or labels differ across modalities, leading to reduced accuracy. To overcome this, our TNF approach implements a tri-branch framework that manages three separate outputs: one for image modality, another for tabular modality, and a third hybrid output that fuses both image and tabular data. The final decision is made through an ensemble method that integrates likelihoods from all three branches. We validate the effectiveness of TNF through extensive experiments, which illustrate its superiority over traditional fusion and ensemble methods in various convolutional neural networks and transformer-based architectures across multiple datasets.


title: SAQIEL: Ultra-Light and Safe Manipulator with Passive 3D Wire Alignment Mechanism

abstract: Improving the safety of collaborative manipulators necessitates the reduction of inertia in the moving part. Within this paper, we introduce a novel approach in the form of a passive 3D wire aligner, serving as a lightweight and low-friction power transmission mechanism, thus achieving the desired low inertia in the manipulator's operation. Through the utilization of this innovation, the consolidation of hefty actuators onto the root link becomes feasible, consequently enabling a supple drive characterized by minimal friction. To demonstrate the efficacy of this device, we fabricate an ultralight 7 degrees of freedom (DoF) manipulator named SAQIEL, boasting a mere 1.5 kg weight for its moving components. Notably, to mitigate friction within SAQIEL's actuation system, we employ a distinctive mechanism that directly winds wires using motors, obviating the need for traditional gear or belt-based speed reduction mechanisms. Through a series of empirical trials, we substantiate that SAQIEL adeptly strikes balance between lightweight design, substantial payload capacity, elevated velocity, precision, and adaptability.


title: PointCore: Efficient Unsupervised Point Cloud Anomaly Detector Using Local-Global Features

abstract: Three-dimensional point cloud anomaly detection that aims to detect anomaly data points from a training set serves as the foundation for a variety of applications, including industrial inspection and autonomous driving. However, existing point cloud anomaly detection methods often incorporate multiple feature memory banks to fully preserve local and global representations, which comes at the high cost of computational complexity and mismatches between features. To address that, we propose an unsupervised point cloud anomaly detection framework based on joint local-global features, termed PointCore. To be specific, PointCore only requires a single memory bank to store local (coordinate) and global (PointMAE) representations and different priorities are assigned to these local-global features, thereby reducing the computational cost and mismatching disturbance in inference. Furthermore, to robust against the outliers, a normalization ranking method is introduced to not only adjust values of different scales to a notionally common scale, but also transform densely-distributed data into a uniform distribution. Extensive experiments on Real3D-AD dataset demonstrate that PointCore achieves competitive inference time and the best performance in both detection and localization as compared to the state-of-the-art Reg3D-AD approach and several competitors.


title: Tsallis Entropy Regularization for Linearly Solvable MDP and Linear Quadratic Regulator

abstract: Shannon entropy regularization is widely adopted in optimal control due to its ability to promote exploration and enhance robustness, e.g., maximum entropy reinforcement learning known as Soft Actor-Critic. In this paper, Tsallis entropy, which is a one-parameter extension of Shannon entropy, is used for the regularization of linearly solvable MDP and linear quadratic regulators. We derive the solution for these problems and demonstrate its usefulness in balancing between exploration and sparsity of the obtained control law.


title: Anodization-free fabrication process for high-quality cross-type Josephson tunnel junctions based on a Nb/Al-AlO$_x$/Nb trilayer

abstract: Josephson tunnel junctions form the basis for various superconducting electronic devices. For this reason, enormous efforts are routinely taken to establish and later on maintain a scalable and reproducible wafer-scale manufacturing process for high-quality Josephson junctions. Here, we present an anodization-free fabrication process for Nb/Al-AlO$_x$/Nb cross-type Josephson junctions that requires only a small number of process steps and that is intrinsically compatible with wafer-scale fabrication. We show that the fabricated junctions are of very high-quality and, compared to other junction types, exhibit not only a significantly reduced capacitance but also an almost rectangular critical current density profile. Our process hence enables the usage of low capacitance Josephson junctions for superconducting electronic devices such as ultra-low noise dc-SQUIDs, microwave SQUID multiplexers based on non-hysteretic rf-SQUIDs and RFSQ circuits.


title: ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models

abstract: 3D asset generation is getting massive amounts of attention, inspired by the recent success of text-guided 2D content creation. Existing text-to-3D methods use pretrained text-to-image diffusion models in an optimization problem or fine-tune them on synthetic data, which often results in non-photorealistic 3D objects without backgrounds. In this paper, we present a method that leverages pretrained text-to-image models as a prior, and learn to generate multi-view images in a single denoising process from real-world data. Concretely, we propose to integrate 3D volume-rendering and cross-frame-attention layers into each block of the existing U-Net network of the text-to-image model. Moreover, we design an autoregressive generation that renders more 3D-consistent images at any viewpoint. We train our model on real-world datasets of objects and showcase its capabilities to generate instances with a variety of high-quality shapes and textures in authentic surroundings. Compared to the existing methods, the results generated by our method are consistent, and have favorable visual quality (-30% FID, -37% KID).


title: Electric field induced resistive switching in M$^{3+}_x$V$_{1-x}$O$_2$ (M$^{3+}$= Ga$^{3+}$, Al$^{3+}$) single crystals at temperatures below the T $\to$ M2 phase transition

abstract: The phase diagram of VO$_2$ strained or doped with several trivalent ions consists of four phases; in order of increasing temperatures, three (M1, T and M2) are insulating while the fourth (R), above ~340 K, is metallic. These phases and the three phase transitions have been thoroughly investigated for about half a century by a wide variety of techniques, including electronic transport. While an upwards jump of the resistance of up to a factor of 2 was observed at the T-M2 transition and a drop of several orders of magnitude was observed at the M2$\to$R one, resistive switching at the M1$\to$T transition remained elusive over all these years. Here we report on the investigation of Ga- and Al-doped VO$_2$ single crystals, following the rather surprising appearance of a small and steep drop of a factor of ~ 0.12 in the resistance of Ga-doped VO$_2$ single crystals detected by pulsed and DC I-V measurements carried out at room temperature, below the T$\to$M2 phase transition. Similar results were obtained also from measurements on Al-doped VO2 single crystals. Raman spectra of Ga-, and Al-doped crystals resolved their structures as function of temperature. The accumulated results of the measurements on Ga-, and Al-doped single crystals provide evidence for identifying the resistive switching at T$_{\rm RS}$<T$_{\rm T\to M2}$ with the M1$\to$T transition.


title: Deployment Challenges of Industrial Intrusion Detection Systems

abstract: With the escalating threats posed by cyberattacks on Industrial Control Systems (ICSs), the development of customized Industrial Intrusion Detection Systems (IIDSs) received significant attention in research. While existing literature proposes effective IIDS solutions evaluated in controlled environments, their deployment in real-world industrial settings poses several challenges. This paper highlights two critical yet often overlooked aspects that significantly impact their practical deployment, i.e., the need for sufficient amounts of data to train the IIDS models and the challenges associated with finding suitable hyperparameters, especially for IIDSs training only on genuine ICS data. Through empirical experiments conducted on multiple state-of-the-art IIDSs and diverse datasets, we establish the criticality of these issues in deploying IIDSs. Our findings show the necessity of extensive malicious training data for supervised IIDSs, which can be impractical considering the complexity of recording and labeling attacks in actual industrial environments. Furthermore, while other IIDSs circumvent the previous issue by requiring only benign training data, these can suffer from the difficulty of setting appropriate hyperparameters, which likewise can diminish their performance. By shedding light on these challenges, we aim to enhance the understanding of the limitations and considerations necessary for deploying effective cybersecurity solutions in ICSs, which might be one reason why IIDSs see few deployments.


title: Global self$-$similarity of dense granular flow in hopper: the role of hopper width

abstract: The influence of hopper width on dense granular flow in a two$-$dimensional hopper is investigated through experiments and simulations. Though the flow rate remains stable for larger hopper widths, a slight reduction in hopper width results in a significant increase in flow rate for smaller hopper widths. Both Beverloo\('\)s and Janda\('\)s formula accurately capture the relationship between the flow rate and outlet size. Flow characteristics in the regions near the outlet exhibit local self$-$similarity, supporting Beverloo and Janda's principles. Moreover, global self$-$similarity is analysed, indicated by the transition in flow state from mass flow in regions far from the outlet to funnel flow near the outlet. The earlier occurrence of this transition favors to enhance the grain velocity and consequently increases the dense flow rate. An exponential scaling law is proposed to describe the dependencies of flow rate, grain velocity, and transition height between the mass flow pattern and the funnel flow pattern on silo width.


title: Enhancing Multi-Domain Automatic Short Answer Grading through an Explainable Neuro-Symbolic Pipeline

abstract: Grading short answer questions automatically with interpretable reasoning behind the grading decision is a challenging goal for current transformer approaches. Justification cue detection, in combination with logical reasoners, has shown a promising direction for neuro-symbolic architectures in ASAG. But, one of the main challenges is the requirement of annotated justification cues in the students' responses, which only exist for a few ASAG datasets. To overcome this challenge, we contribute (1) a weakly supervised annotation procedure for justification cues in ASAG datasets, and (2) a neuro-symbolic model for explainable ASAG based on justification cues. Our approach improves upon the RMSE by 0.24 to 0.3 compared to the state-of-the-art on the Short Answer Feedback dataset in a bilingual, multi-domain, and multi-question training setup. This result shows that our approach provides a promising direction for generating high-quality grades and accompanying explanations for future research in ASAG and educational NLP.


title: Simulation-based High-Speed Elongational Rheometer for Carreau-type Materials

abstract: For the simulation-based design of fiber melt spinning processes, the accurate modeling of the processed polymer with regard to its material behavior is crucial. In this work, we develop a high-speed elongational rheometer for Carreau-type materials, making use of process simulations and fiber diameter measurements. The procedure is based on a unified formulation of the fiber spinning model for all material types (Newtonian and non-Newtonian), whose material laws are strictly monotone in the strain rate. The parametrically described material law for the elongational viscosity implies a nonlinear optimization problem for the parameter identification, for which we propose an efficient, robust gradient-based method. The work can be understood as a proof of concept, a generalization to other, more complex materials is possible.


title: A Simple Baseline for Efficient Hand Mesh Reconstruction

abstract: 3D hand pose estimation has found broad application in areas such as gesture recognition and human-machine interaction tasks. As performance improves, the complexity of the systems also increases, which can limit the comparative analysis and practical implementation of these methods. In this paper, we propose a simple yet effective baseline that not only surpasses state-of-the-art (SOTA) methods but also demonstrates computational efficiency. To establish this baseline, we abstract existing work into two components: a token generator and a mesh regressor, and then examine their core structures. A core structure, in this context, is one that fulfills intrinsic functions, brings about significant improvements, and achieves excellent performance without unnecessary complexities. Our proposed approach is decoupled from any modifications to the backbone, making it adaptable to any modern models. Our method outperforms existing solutions, achieving state-of-the-art (SOTA) results across multiple datasets. On the FreiHAND dataset, our approach produced a PA-MPJPE of 5.7mm and a PA-MPVPE of 6.0mm. Similarly, on the Dexycb dataset, we observed a PA-MPJPE of 5.5mm and a PA-MPVPE of 5.0mm. As for performance speed, our method reached up to 33 frames per second (fps) when using HRNet and up to 70 fps when employing FastViT-MA36


title: Rotation effect on the deconfinement phase transition in holographic QCD

abstract: The impact of rotation on the deconfinement phase transition under the EM system of the soft and the hard wall models in holographic QCD is studied in this paper. The metric by cylindrical coordinates with rotation is introduced into the system to calculate the Hawking temperature. The first holographic study on the influence of the radius of a homogeneous rotating system on the phase diagram is proposed. It is found that the phase transition temperature hardly changes with the rotation angular velocity for a small rotation radius. Only with a larger rotation radius can the change in rotational angular velocity significantly alter the phase transition temperature. The phase transition temperature decreases rapidly with the increase of rotation angular velocity as the rotation radius increases.


title: Lithium Abundances from the LAMOST Med-Resolution Survey Data Release 9

abstract: Lithium is a fragile but crucial chemical element in the universe, exhibits interesting and complex behaviors. Thanks to the massive spectroscopic data from the Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST) medium-resolution survey (MRS), we can investigate the lithium abundances in a large and diverse sample of stars, which could bring vital help to study the origin and evolution of lithium. In this work, we use the Li 6,707.8 {\AA} line to derive the lithium abundance through a template-matching method. A catalog of precise lithium abundance is presented for 795,384 spectra corresponding to 455,752 stars from the LAMOST MRS Data Release (DR) 9. Comparing our results with those of external high-resolution references we find a good consistency with a typical deviation of {\sigma} A(Li) ~ 0.2 dex. We also analyze the internal errors using stars that have multiple LAMOST MRS observations, which will reach as low as 0.1 dex when the signal-to-noise ratio (S/N) of the spectra > 20. Besides, our result indicates that a small fraction of giant stars still exhibit surprisingly high amount of lithium contents, and 967 stars are identified as Li-rich giants with A(Li) > 1.5 dex, accounting for ~ 2.6% of our samples. If one takes into account the fact that nearly all stars deplete lithium during the main sequence, then the fraction of Li-rich stars may exceed 2.6% much. This new catalog covers a wide range of stellar evolutionary stages from pre-main sequence to giants, and will provide help to the further study of the chemical evolution of lithium.


title: SMAUG: A Sliding Multidimensional Task Window-Based MARL Framework for Adaptive Real-Time Subtask Recognition

abstract: Instead of making behavioral decisions directly from the exponentially expanding joint observational-action space, subtask-based multi-agent reinforcement learning (MARL) methods enable agents to learn how to tackle different subtasks. Most existing subtask-based MARL methods are based on hierarchical reinforcement learning (HRL). However, these approaches often limit the number of subtasks, perform subtask recognition periodically, and can only identify and execute a specific subtask within the predefined fixed time period, which makes them inflexible and not suitable for diverse and dynamic scenarios with constantly changing subtasks. To break through above restrictions, a \textbf{S}liding \textbf{M}ultidimensional t\textbf{A}sk window based m\textbf{U}ti-agent reinforcement learnin\textbf{G} framework (SMAUG) is proposed for adaptive real-time subtask recognition. It leverages a sliding multidimensional task window to extract essential information of subtasks from trajectory segments concatenated based on observed and predicted trajectories in varying lengths. An inference network is designed to iteratively predict future trajectories with the subtask-oriented policy network. Furthermore, intrinsic motivation rewards are defined to promote subtask exploration and behavior diversity. SMAUG can be integrated with any Q-learning-based approach. Experiments on StarCraft II show that SMAUG not only demonstrates performance superiority in comparison with all baselines but also presents a more prominent and swift rise in rewards during the initial training stage.


title: NusaBERT: Teaching IndoBERT to be Multilingual and Multicultural

abstract: Indonesia's linguistic landscape is remarkably diverse, encompassing over 700 languages and dialects, making it one of the world's most linguistically rich nations. This diversity, coupled with the widespread practice of code-switching and the presence of low-resource regional languages, presents unique challenges for modern pre-trained language models. In response to these challenges, we developed NusaBERT, building upon IndoBERT by incorporating vocabulary expansion and leveraging a diverse multilingual corpus that includes regional languages and dialects. Through rigorous evaluation across a range of benchmarks, NusaBERT demonstrates state-of-the-art performance in tasks involving multiple languages of Indonesia, paving the way for future natural language understanding research for under-represented languages.


title: AllSpark: Reborn Labeled Features from Unlabeled in Transformer for Semi-Supervised Semantic Segmentation

abstract: Semi-supervised semantic segmentation (SSSS) has been proposed to alleviate the burden of time-consuming pixel-level manual labeling, which leverages limited labeled data along with larger amounts of unlabeled data. Current state-of-the-art methods train the labeled data with ground truths and unlabeled data with pseudo labels. However, the two training flows are separate, which allows labeled data to dominate the training process, resulting in low-quality pseudo labels and, consequently, sub-optimal results. To alleviate this issue, we present AllSpark, which reborns the labeled features from unlabeled ones with the channel-wise cross-attention mechanism. We further introduce a Semantic Memory along with a Channel Semantic Grouping strategy to ensure that unlabeled features adequately represent labeled features. The AllSpark shed new light on the architecture level designs of SSSS rather than framework level, which avoids increasingly complicated training pipeline designs. It can also be regarded as a flexible bottleneck module that can be seamlessly integrated into a general transformer-based segmentation model. The proposed AllSpark outperforms existing methods across all evaluation protocols on Pascal, Cityscapes and COCO benchmarks without bells-and-whistles. Code and model weights are available at: https://github.com/xmed-lab/AllSpark.


title: Yang-Mills models on Noncommutative background

abstract: In our previous publications we have developed some elements of Noncommutative calculus on the enveloping algebras of $A_m$ type, in particular, analogs of the partial derivatives and de Rham complex were defined. Also, we introduced the notion of quantization with Noncommutative configuration space and quantized a few dynamical models in this sense. In the current paper we propose a method of quantizing the Yang-Mills models in same sense.


title: Macroscopic auxiliary asymptotic preserving neural networks for the linear radiative transfer equations

abstract: We develop a Macroscopic Auxiliary Asymptotic-Preserving Neural Network (MA-APNN) method to solve the time-dependent linear radiative transfer equations (LRTEs), which have a multi-scale nature and high dimensionality. To achieve this, we utilize the Physics-Informed Neural Networks (PINNs) framework and design a new adaptive exponentially weighted Asymptotic-Preserving (AP) loss function, which incorporates the macroscopic auxiliary equation that is derived from the original transfer equation directly and explicitly contains the information of the diffusion limit equation. Thus, as the scale parameter tends to zero, the loss function gradually transitions from the transport state to the diffusion limit state. In addition, the initial data, boundary conditions, and conservation laws serve as the regularization terms for the loss. We present several numerical examples to demonstrate the effectiveness of MA-APNNs.