title: The Main Electrode System of the Nab Experiment and the Analysis of the Performance in the Measurement of the Fierz Term b

abstract: The Nab collaboration will study free neutron beta decay at the Spallation Neutron Source at Oak Ridge National Lab. A neutron decays into a proton, an electron and an anti-neutrino in this process, where the energy of the outgoing protons and electrons are collected to determine (1) the electron-antineutrino correlation co-efficient $a$ to the precision of |$\Delta a/a$|<=$10^{-3}$ and (2) the Fierz interference term $b$ to the precision of |$\Delta b/b$|<=$3*10^{-3}$. From the measurement of $a$, we can calculate the axial-vector to vector coupling ratio $\lambda$. Together with the neutron lifetime measurement, we could also calculate the upper right element of the Cabbibo-Kobayashi-Maskawa Matrix, and test the unitarity of that matrix. The measurement of $b$ could shed light on the physics beyond the Standard Model since $b$ is predicted to be 0 by the $V-A$ structure of weak interaction in the Standard Model. This thesis presents the design of Nab electrode system, and the solution to a major systematic effect in the measurement of $a$: the requirement of having a low electrical field environment in the neutron decay region. The electrode system has been built and installed successfully, and as our characterization and its analysis shows, the electrode system meets the required specifications. This thesis also gives a systematic uncertainty study for $b$ measurement and provides a table of the requirements for the $b$ measurement...


title: Design and characterization of individual addressing optics based on multi-channel acousto-optic modulator for $^{171}$Yb$^+$ qubits

abstract: We present the design and characterization of individual addressing optics based on a multi-channel acousto-optic modulator (AOM) for trapped ytterbium-171 ions. The design parameters of the individual addressing system were determined based on the tradeoff between the expected crosstalk and the required numerical aperture of the projection objective lens. The target beam diameter and separation were 1.90 $\mu$m and 4.28 $\mu$m, respectively. The individual beams shaped by the projection optics were characterized by an imaging sensor and a field probe ion. The resulting effective beam diameters and separations were approximately 2.34--2.36 $\mu$m and 4.31 $\mu$m, respectively, owing to residual aberration.


title: Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignment

abstract: Evaluating and Rethinking the current landscape of Large Multimodal Models (LMMs), we observe that widely-used visual-language projection approaches (e.g., Q-former or MLP) focus on the alignment of image-text descriptions yet ignore the visual knowledge-dimension alignment, i.e., connecting visuals to their relevant knowledge. Visual knowledge plays a significant role in analyzing, inferring, and interpreting information from visuals, helping improve the accuracy of answers to knowledge-based visual questions. In this paper, we mainly explore improving LMMs with visual-language knowledge alignment, especially aimed at challenging knowledge-based visual question answering (VQA). To this end, we present a Cognitive Visual-Language Mapper (CVLM), which contains a pretrained Visual Knowledge Aligner (VKA) and a Fine-grained Knowledge Adapter (FKA) used in the multimodal instruction tuning stage. Specifically, we design the VKA based on the interaction between a small language model and a visual encoder, training it on collected image-knowledge pairs to achieve visual knowledge acquisition and projection. FKA is employed to distill the fine-grained visual knowledge of an image and inject it into Large Language Models (LLMs). We conduct extensive experiments on knowledge-based VQA benchmarks and experimental results show that CVLM significantly improves the performance of LMMs on knowledge-based VQA (average gain by 5.0%). Ablation studies also verify the effectiveness of VKA and FKA, respectively. The codes are available at https://github.com/HITsz-TMG/Cognitive-Visual-Language-Mapper


title: Analysis of Multi-Source Language Training in Cross-Lingual Transfer

abstract: The successful adaptation of multilingual language models (LMs) to a specific language-task pair critically depends on the availability of data tailored for that condition. While cross-lingual transfer (XLT) methods have contributed to addressing this data scarcity problem, there still exists ongoing debate about the mechanisms behind their effectiveness. In this work, we focus on one of promising assumptions about inner workings of XLT, that it encourages multilingual LMs to place greater emphasis on language-agnostic or task-specific features. We test this hypothesis by examining how the patterns of XLT change with a varying number of source languages involved in the process. Our experimental findings show that the use of multiple source languages in XLT-a technique we term Multi-Source Language Training (MSLT)-leads to increased mingling of embedding spaces for different languages, supporting the claim that XLT benefits from making use of language-independent information. On the other hand, we discover that using an arbitrary combination of source languages does not always guarantee better performance. We suggest simple heuristics for identifying effective language combinations for MSLT and empirically prove its effectiveness.


title: Modular forms and hierarchical Yukawa couplings in heterotic Calabi-Yau compactifications

abstract: We study the modular symmetry in heterotic string theory on Calabi-Yau threefolds. In particular, we examine whether moduli-dependent holomorphic Yukawa couplings are described by modular forms in the context of heterotic string theory with standard embedding. We find that $SL(2,\mathbb{Z})$ modular symmetry emerges in asymptotic regions of the Calabi-Yau moduli space. The instanton-corrected holomorphic Yukawa couplings are then given by modular forms under $SL(2,\mathbb{Z})$ or its congruence subgroups such as $\Gamma_0(3)$ and $\Gamma_0(4)$. In addition to the modular symmetry, it turns out that another coupling selection rule controls the structure of holomorphic Yukawa couplings. Furthermore, the coexistence of both the positive and negative modular weights for matter fields leads to a hierarchical structure of matter field K\"ahler metric. Thus, these holomorphic modular forms and the matter field K\"ahler metric play an important role in realizing a hierarchical structure of physical Yukawa couplings.


title: Fabrication of high electron mobility and high photoluminescence quantum yield nanoscrolled monolayer MoS2

abstract: We fabricated the 1D nanoscrolled monolayer MoS2 (1L-MoS2) with superior characteristics from 1L-MoS2 film in a facile route, using a suitable organic solvent with optimum surface tension, evaporation rate and dielectric constant, which facilitates the controlled scroll formation. These nanoscrolls behave as multilayers in morphology and monolayer electronically. The nanoscrolls exhibited a direct optical gap with enhanced photoluminescence quantum yield stemming from the weak interlayer coupling among constituent layers and were corroborated by low-frequency Raman measurements and Kelvin probe force microscopy measurements. Furthermore, enhanced photoluminescence emission after annealing uncovers the thermal stability of nanoscrolls. In addition, conducting atomic force microscopy results exhibit a significantly higher photocurrent in the nanoscrolled 1L-MoS2 compared to the 1L-MoS2. We also realized significantly improved field effect transistor device parameters in nanoscrolled 1L-MoS2 devices. In nanoscrolled devices, we report the highest mobility value of 2400 cm2V-1s-1 reported in any form of 1L-MoS2.


title: On the application of subspace migration from scattering matrix with constant-valued diagonal elements in microwave imaging

abstract: We consider the application of a subspace migration (SM) algorithm to quickly identify small objects in microwave imaging. In various problems, it is easy to measure the diagonal elements of the scattering matrix if the location of the transmitter and the receiver is the same. To address this issue, several studies have been conducted by setting the diagonal elements to zero. In this paper, we generalize the imaging problem by setting diagonal elements of the scattering matrix as a constant with the application of SM. To show the applicability of SM and its dependence on the constant, we show that the imaging function of SM can be represented in terms of an infinite series of the Bessel functions of integer order, antenna number and arrangement, and applied constant. This result enables us to discover some further properties, including the unique determination of objects. We also demonstrated simulation results with synthetic data to support the theoretical result.


title: Event-aware Video Corpus Moment Retrieval

abstract: Video Corpus Moment Retrieval (VCMR) is a practical video retrieval task focused on identifying a specific moment within a vast corpus of untrimmed videos using the natural language query. Existing methods for VCMR typically rely on frame-aware video retrieval, calculating similarities between the query and video frames to rank videos based on maximum frame similarity.However, this approach overlooks the semantic structure embedded within the information between frames, namely, the event, a crucial element for human comprehension of videos. Motivated by this, we propose EventFormer, a model that explicitly utilizes events within videos as fundamental units for video retrieval. The model extracts event representations through event reasoning and hierarchical event encoding. The event reasoning module groups consecutive and visually similar frame representations into events, while the hierarchical event encoding encodes information at both the frame and event levels. We also introduce anchor multi-head self-attenion to encourage Transformer to capture the relevance of adjacent content in the video. The training of EventFormer is conducted by two-branch contrastive learning and dual optimization for two sub-tasks of VCMR. Extensive experiments on TVR, ANetCaps, and DiDeMo benchmarks show the effectiveness and efficiency of EventFormer in VCMR, achieving new state-of-the-art results. Additionally, the effectiveness of EventFormer is also validated on partially relevant video retrieval task.


title: Spot Check Equivalence: an Interpretable Metric for Information Elicitation Mechanisms

abstract: Because high-quality data is like oxygen for AI systems, effectively eliciting information from crowdsourcing workers has become a first-order problem for developing high-performance machine learning algorithms. Two prevalent paradigms, spot-checking and peer prediction, enable the design of mechanisms to evaluate and incentivize high-quality data from human labelers. So far, at least three metrics have been proposed to compare the performances of these techniques [33, 8, 3]. However, different metrics lead to divergent and even contradictory results in various contexts. In this paper, we harmonize these divergent stories, showing that two of these metrics are actually the same within certain contexts and explain the divergence of the third. Moreover, we unify these different contexts by introducing \textit{Spot Check Equivalence}, which offers an interpretable metric for the effectiveness of a peer prediction mechanism. Finally, we present two approaches to compute spot check equivalence in various contexts, where simulation results verify the effectiveness of our proposed metric.


title: The Effect of AGN Feedback on the Lyman-{\alpha} Forest Signature of Galaxy Protoclusters at z~2.3

abstract: The intergalactic medium (IGM) in the vicinity of galaxy protoclusters are interesting testbeds to study complex baryonic effects such as gravitational shocks and feedback. Here, we utilize hydrodynamical simulations from the SIMBA and The Three Hundred suites to study the mechanisms influencing large-scale Lyman-$\alpha$ transmission in 2<z<2.5 protoclusters observed in the COSMOS field. We focus on the matter overdensity-Lyman-$\alpha$ transmission relation $(\delta_m-\delta_F)$ on Megaparsec-scales in these protoclusters, which is hypothesized to be sensitive to the feedback implementations. The lower-density regions represented by the SIMBA-100 cosmological volume trace the power-law $\delta_m-\delta_F$ relationship often known as the fluctuating Gunn-Peterson approximation (FGPA). This trend is continued into higher-density regions covered by the 300-GadgetMUSIC simulations that implement stellar feedback only. The 300-GadgetX and 300-SIMBA simulations, with AGN thermal and AGN jet feedback respectively, exhibit progressively more Lyman-$\alpha$ transmission at fixed overdensity. Compared with the 7 protoclusters observed in the CLAMATO$\times$COSTCO data, only 2 appear consistent with the FGPA. The others exhibit clear deviations: 4 follow the trend of AGN X-ray thermal feedback models while the COSTCO-I protocluster appears to reflect intense jet feedback. The large discrepancy with the stellar-feedback-only 300-GadgetMUSIC model disfavours large-scale heating from gravitational collapse and/or stellar feedback. This indicates that some form of AGN feedback is likely at play in the observed protoclusters, and possibly long-ranged AGN jets in the case of COSTCO-I. While more detailed and resolved simulations are required to move forward, our findings open new avenues for probing AGN feedback at Cosmic Noon.


title: Capillary levelling of thin liquid films of power-law rheology

abstract: We find solutions that describe the levelling of a thin fluid film, comprising a non-Newtonian power-law fluid, that coats a substrate and evolves under the influence of surface tension. We consider the evolution from both periodic and localised initial conditions as separate cases. Particular (similarity) solutions in each of these two cases exhibit the generic property that the profiles are weakly singular (that is, higher-order derivatives do not exist), at points where the pressure gradient vanishes. Numerical simulations of the thin film equation, with either periodic or localised initial condition, are shown to approach the appropriate particular solution.


title: Kaon production in HADES Au+Au collisions at $\sqrt{s_{\rm NN}}=2.4$ GeV

abstract: Within an isospin- and momentum-dependent transport model by including the kaon production, we study the kaon prodution in heavy-ion collisions (HICs) at SIS (Darmstadt Schwerionen Synchrotron, GSI) energies. Based on simulations of a centrality of 0-40\% Au + Au collision at $\sqrt{s_{NN}}=2.4$ GeV, a typical reaction that has been carried out by the HADES Collaborator, we find that the medium modification of kaon masses plays a vital role in studying the kaon productions in HICs, and is also unavoidable for the successful interpretation of the HADES data on kaon rapidity distributions and transverse mass spectra. Moreover, we also find that the kaon transverse and directed flows are affected significantly by both the kaon potential or dispersion relation and medium modification of kaon masses, and thus could be used in HICs as the sensitive probes to detect the kaon potential or dispersion relation as well as the medium modification of kaon masses.


title: Multilingual Coreference Resolution in Low-resource South Asian Languages

abstract: Coreference resolution involves the task of identifying text spans within a discourse that pertain to the same real-world entity. While this task has been extensively explored in the English language, there has been a notable scarcity of publicly accessible resources and models for coreference resolution in South Asian languages. We introduce a Translated dataset for Multilingual Coreference Resolution (TransMuCoRes) in 31 South Asian languages using off-the-shelf tools for translation and word-alignment. Nearly all of the predicted translations successfully pass a sanity check, and 75% of English references align with their predicted translations. Using multilingual encoders, two off-the-shelf coreference resolution models were trained on a concatenation of TransMuCoRes and a Hindi coreference resolution dataset with manual annotations. The best performing model achieved a score of 64 and 68 for LEA F1 and CoNLL F1, respectively, on our test-split of Hindi golden set. This study is the first to evaluate an end-to-end coreference resolution model on a Hindi golden set. Furthermore, this work underscores the limitations of current coreference evaluation metrics when applied to datasets with split antecedents, advocating for the development of more suitable evaluation metrics.


title: On the Expressive Power of a Variant of the Looped Transformer

abstract: Besides natural language processing, transformers exhibit extraordinary performance in solving broader applications, including scientific computing and computer vision. Previous works try to explain this from the expressive power and capability perspectives that standard transformers are capable of performing some algorithms. To empower transformers with algorithmic capabilities and motivated by the recently proposed looped transformer (Yang et al., 2024; Giannou et al., 2023), we design a novel transformer block, dubbed Algorithm Transformer (abbreviated as AlgoFormer). Compared with the standard transformer and vanilla looped transformer, the proposed AlgoFormer can achieve significantly higher expressiveness in algorithm representation when using the same number of parameters. In particular, inspired by the structure of human-designed learning algorithms, our transformer block consists of a pre-transformer that is responsible for task pre-processing, a looped transformer for iterative optimization algorithms, and a post-transformer for producing the desired results after post-processing. We provide theoretical evidence of the expressive power of the AlgoFormer in solving some challenging problems, mirroring human-designed algorithms. Furthermore, some theoretical and empirical results are presented to show that the designed transformer has the potential to be smarter than human-designed algorithms. Experimental results demonstrate the empirical superiority of the proposed transformer in that it outperforms the standard transformer and vanilla looped transformer in some challenging tasks.


title: ToDo: Token Downsampling for Efficient Generation of High-Resolution Images

abstract: Attention mechanism has been crucial for image diffusion models, however, their quadratic computational complexity limits the sizes of images we can process within reasonable time and memory constraints. This paper investigates the importance of dense attention in generative image models, which often contain redundant features, making them suitable for sparser attention mechanisms. We propose a novel training-free method ToDo that relies on token downsampling of key and value tokens to accelerate Stable Diffusion inference by up to 2x for common sizes and up to 4.5x or more for high resolutions like 2048x2048. We demonstrate that our approach outperforms previous methods in balancing efficient throughput and fidelity.


title: One-sided Drazin inverses in Banach algebras and perturbations of B-Fredholm spectra

abstract: The famous Drazin inverse and generalized Drazin inverse were introduced by Drazin in 1958 and Koliha in 1996, respectively. In the present paper, the author introduces the concepts of left and right (generalized) Drazin inverses, which are the one-sided versions of classical (generalized) Drazin inverses, in Banach algebras. Several characterizations of one-sided (generalized) Drazin invertible operators on Banach spaces are given. By utilizing the one-sided Drazin invertible spectra, the characterizations of B-Fredholm spectra for Banach space operators are obtained. These perturbational results can be regarded as generalizations of classical Fredholm theory in Banach spaces.


title: Flexible Physical Camouflage Generation Based on a Differential Approach

abstract: This study introduces a novel approach to neural rendering, specifically tailored for adversarial camouflage, within an extensive 3D rendering framework. Our method, named FPA, goes beyond traditional techniques by faithfully simulating lighting conditions and material variations, ensuring a nuanced and realistic representation of textures on a 3D target. To achieve this, we employ a generative approach that learns adversarial patterns from a diffusion model. This involves incorporating a specially designed adversarial loss and covert constraint loss to guarantee the adversarial and covert nature of the camouflage in the physical world. Furthermore, we showcase the effectiveness of the proposed camouflage in sticker mode, demonstrating its ability to cover the target without compromising adversarial information. Through empirical and physical experiments, FPA exhibits strong performance in terms of attack success rate and transferability. Additionally, the designed sticker-mode camouflage, coupled with a concealment constraint, adapts to the environment, yielding diverse styles of texture. Our findings highlight the versatility and efficacy of the FPA approach in adversarial camouflage applications.


title: Improving Video Corpus Moment Retrieval with Partial Relevance Enhancement

abstract: Video Corpus Moment Retrieval (VCMR) is a new video retrieval task aimed at retrieving a relevant moment from a large corpus of untrimmed videos using a text query. The relevance between the video and query is partial, mainly evident in two aspects:~(1)~Scope: The untrimmed video contains many frames, but not all are relevant to the query. Strong relevance is typically observed only within the relevant moment.~(2)~Modality: The relevance of the query varies with different modalities. Action descriptions align more with visual elements, while character conversations are more related to textual information.Existing methods often treat all video contents equally, leading to sub-optimal moment retrieval. We argue that effectively capturing the partial relevance between the query and video is essential for the VCMR task. To this end, we propose a Partial Relevance Enhanced Model~(PREM) to improve VCMR. VCMR involves two sub-tasks: video retrieval and moment localization. To align with their distinct objectives, we implement specialized partial relevance enhancement strategies. For video retrieval, we introduce a multi-modal collaborative video retriever, generating different query representations for the two modalities by modality-specific pooling, ensuring a more effective match. For moment localization, we propose the focus-then-fuse moment localizer, utilizing modality-specific gates to capture essential content. We also introduce relevant content-enhanced training methods for both retriever and localizer to enhance the ability of model to capture relevant content. Experimental results on TVR and DiDeMo datasets show that the proposed model outperforms the baselines, achieving a new state-of-the-art of VCMR. The code is available at \url{https://github.com/hdy007007/PREM}.


title: BBA: Bi-Modal Behavioral Alignment for Reasoning with Large Vision-Language Models

abstract: Multimodal reasoning stands as a pivotal capability for large vision-language models (LVLMs). The integration with Domain-Specific Languages (DSL), offering precise visual representations, equips these models with the opportunity to execute more accurate reasoning in complex and professional domains. However, the vanilla Chain-of-Thought (CoT) prompting method faces challenges in effectively leveraging the unique strengths of visual and DSL representations, primarily due to their differing reasoning mechanisms. Additionally, it often falls short in addressing critical steps in multi-step reasoning tasks. To mitigate these challenges, we introduce the \underline{B}i-Modal \underline{B}ehavioral \underline{A}lignment (BBA) prompting method, designed to maximize the potential of DSL in augmenting complex multi-modal reasoning tasks. This method initiates by guiding LVLMs to create separate reasoning chains for visual and DSL representations. Subsequently, it aligns these chains by addressing any inconsistencies, thus achieving a cohesive integration of behaviors from different modalities. Our experiments demonstrate that BBA substantially improves the performance of GPT-4V(ision) on geometry problem solving ($28.34\% \to 34.22\%$), chess positional advantage prediction ($42.08\% \to 46.99\%$) and molecular property prediction ($77.47\% \to 83.52\%$).


title: TransGOP: Transformer-Based Gaze Object Prediction

abstract: Gaze object prediction aims to predict the location and category of the object that is watched by a human. Previous gaze object prediction works use CNN-based object detectors to predict the object's location. However, we find that Transformer-based object detectors can predict more accurate object location for dense objects in retail scenarios. Moreover, the long-distance modeling capability of the Transformer can help to build relationships between the human head and the gaze object, which is important for the GOP task. To this end, this paper introduces Transformer into the fields of gaze object prediction and proposes an end-to-end Transformer-based gaze object prediction method named TransGOP. Specifically, TransGOP uses an off-the-shelf Transformer-based object detector to detect the location of objects and designs a Transformer-based gaze autoencoder in the gaze regressor to establish long-distance gaze relationships. Moreover, to improve gaze heatmap regression, we propose an object-to-gaze cross-attention mechanism to let the queries of the gaze autoencoder learn the global-memory position knowledge from the object detector. Finally, to make the whole framework end-to-end trained, we propose a Gaze Box loss to jointly optimize the object detector and gaze regressor by enhancing the gaze heatmap energy in the box of the gaze object. Extensive experiments on the GOO-Synth and GOO-Real datasets demonstrate that our TransGOP achieves state-of-the-art performance on all tracks, i.e., object detection, gaze estimation, and gaze object prediction. Our code will be available at https://github.com/chenxi-Guo/TransGOP.git.


title: Learning Pixel-wise Continuous Depth Representation via Clustering for Depth Completion

abstract: Depth completion is a long-standing challenge in computer vision, where classification-based methods have made tremendous progress in recent years. However, most existing classification-based methods rely on pre-defined pixel-shared and discrete depth values as depth categories. This representation fails to capture the continuous depth values that conform to the real depth distribution, leading to depth smearing in boundary regions. To address this issue, we revisit depth completion from the clustering perspective and propose a novel clustering-based framework called CluDe which focuses on learning the pixel-wise and continuous depth representation. The key idea of CluDe is to iteratively update the pixel-shared and discrete depth representation to its corresponding pixel-wise and continuous counterpart, driven by the real depth distribution. Specifically, CluDe first utilizes depth value clustering to learn a set of depth centers as the depth representation. While these depth centers are pixel-shared and discrete, they are more in line with the real depth distribution compared to pre-defined depth categories. Then, CluDe estimates offsets for these depth centers, enabling their dynamic adjustment along the depth axis of the depth distribution to generate the pixel-wise and continuous depth representation. Extensive experiments demonstrate that CluDe successfully reduces depth smearing around object boundaries by utilizing pixel-wise and continuous depth representation. Furthermore, CluDe achieves state-of-the-art performance on the VOID datasets and outperforms classification-based methods on the KITTI dataset.


title: Mechanism Design with Sequential-Move Games: Revelation Principle

abstract: Traditionally, mechanism design focuses on simultaneous-move games (e.g., Myerson (1981)). In this paper, we study mechanism design with sequential-move games, and provide two results on revelation principles for general solution concepts (e.g., perfect Bayesian equilibrium, obvious dominance, strong-obvious dominance). First, if a solution concept is additive, implementation in sequential-move games is equivalent to implementation in simultaneous-move games. Second, for any solution concept \r{ho} and any social choice function f, we identify a canonical operator {\gamma}^{(\r{ho},f)}, which is defined on primitives. We prove that, if \r{ho} is monotonic, f can be implemented by a sequential-move game if and only if {\gamma}^{(\r{ho},f)} is achievable, which translates a complicated mechanism design problem into checking some conditions defined on primitives. Most of the existing solution concepts are either additive or monotonic.


title: Maker-Breaker domination game played on corona products of graphs

abstract: In the Maker-Breaker domination game, Dominator and Staller play on a graph $G$ by taking turns in which each player selects a not yet played vertex of $G$. Dominator's goal is to select all the vertices in a dominating set, while Staller aims to prevent this from happening. In this paper, the game is investigated on corona products of graphs. Its outcome is determined as a function of the outcome of the game on the second factor. Staller-Maker-Breaker domination numbers are determined for arbitrary corona products, while Maker-Breaker domination numbers of corona products are bounded from both sides. All the bounds presented are demonstrated to be sharp. Corona products as well as general graphs with small (Staller-)Maker-Breaker domination numbers are described.


title: Mastering the Game of Guandan with Deep Reinforcement Learning and Behavior Regulating

abstract: Games are a simplified model of reality and often serve as a favored platform for Artificial Intelligence (AI) research. Much of the research is concerned with game-playing agents and their decision making processes. The game of Guandan (literally, "throwing eggs") is a challenging game where even professional human players struggle to make the right decision at times. In this paper we propose a framework named GuanZero for AI agents to master this game using Monte-Carlo methods and deep neural networks. The main contribution of this paper is about regulating agents' behavior through a carefully designed neural network encoding scheme. We then demonstrate the effectiveness of the proposed framework by comparing it with state-of-the-art approaches.


title: LongWanjuan: Towards Systematic Measurement for Long Text Quality

abstract: The quality of training data are crucial for enhancing the long-text capabilities of foundation models. Despite existing efforts to refine data quality through heuristic rules and evaluations based on data diversity and difficulty, there's a lack of systematic approaches specifically tailored for assessing long texts. Addressing this gap, our work systematically measures the quality of long texts by evaluating three fundamental linguistic dimensions: coherence, cohesion, and complexity. Drawing inspiration from the aforementioned three dimensions, we introduce a suite of metrics designed to evaluate the quality of long texts, encompassing both statistical and pre-trained language model-based ones. Leveraging these metrics, we present LongWanjuan, a bilingual dataset specifically tailored to enhance the training of language models for long-text tasks with over 160B tokens. In LongWanjuan, we categorize long texts into holistic, aggregated, and chaotic types, enabling a detailed analysis of long-text quality. Furthermore, we devise a data mixture recipe that strategically balances different types of long texts within LongWanjuan, leading to significant improvements in model performance on long-text tasks. The code and dataset are available at https://github.com/OpenLMLab/LongWanjuan.


title: WinoViz: Probing Visual Properties of Objects Under Different States

abstract: Humans perceive and comprehend different visual properties of an object based on specific contexts. For instance, we know that a banana turns brown ``when it becomes rotten,'' whereas it appears green ``when it is unripe.'' Previous studies on probing visual commonsense knowledge have primarily focused on examining language models' understanding of typical properties (e.g., colors and shapes) of objects. We present WinoViz, a text-only evaluation dataset, consisting of 1,380 examples that probe the reasoning abilities of language models regarding variant visual properties of objects under different contexts or states. Our task is challenging since it requires pragmatic reasoning (finding intended meanings) and visual knowledge reasoning. We also present multi-hop data, a more challenging version of our data, which requires multi-step reasoning chains to solve our task. In our experimental analysis, our findings are: a) Large language models such as GPT-4 demonstrate effective performance, but when it comes to multi-hop data, their performance is significantly degraded. b) Large models perform well on pragmatic reasoning, but visual knowledge reasoning is a bottleneck in our task. c) Vision-language models outperform their language-model counterparts. d) A model with machine-generated images performs poorly in our task. This is due to the poor quality of the generated images.


title: Period-Luminosity-Metallicity-Color Relations of Late-type Contact Binaries in the Big Data Era

abstract: Binary stars ubiquitous throughout the universe are important. Contact binaries (CBs) possessing Period-Luminosity (PL) relations could be adopted as distance tracers. The PL relations of CBs are influenced by metallicity abundance and color index, which are connected to both the radius and luminosity of stars. Here we propose fine relations of Period-Luminosity-Metallicity-Color (PLZC) from the ultraviolet to infrared bands based on current surveys. The accuracy of the distance estimation is 6\% and 8\%, respectively, depending on the PLZC relations of the CBs in the infrared and optical bands of the collected data. PLZC models are still more accurate than PLC models in determining intrinsic luminosity, notwithstanding their limited improvement. Meanwhile, these relations based on synthetic photometry are also calibrated. On the basis of the synthetic photometry, a 6\% accuracy of distance is estimated. The measured or synthetic data of PLZC or PLC relations in infrared bands comes first in the list of suggestions for distance estimations, and is followed by the measured data of optical bands.


title: Delay-Aware Semantic Sampling in Power Electronic Systems

abstract: In power electronic systems (PES), attacks on data availability such as latency attacks, data dropouts, and time-synchronization attacks (TSAs) continue to pose significant threats to both the communication network and the control system performance. As per the conventional norms of communication engineering, PES still rely on time synchronized sampling, which translates every received message with equal importance. In this paper, we go beyond event-triggered sampling/estimation to integrate semantic principles into the sampling process for each distributed energy resource (DER), which not only compensates for delayed communicated signals by reconstruction of a new signal from the inner control layer dynamics, but also evaluates the reconstruction stage using key semantic requirements, namely Freshness, Relevance and Priority for good dynamic performance. As a result, the sparsity provided by event-driven sampling of internal control loop dynamics translates as semantics in PES. The proposed scheme has been extensively tested and validated on a modified IEEE 37-bus AC distribution system, under many operating conditions and noisy environment in OPAL-RT environment to establish its robustness, model-free design ability and adaptive behavior to dynamic cyber graph topologies.


title: A Multimodal In-Context Tuning Approach for E-Commerce Product Description Generation

abstract: In this paper, we propose a new setting for generating product descriptions from images, augmented by marketing keywords. It leverages the combined power of visual and textual information to create descriptions that are more tailored to the unique features of products. For this setting, previous methods utilize visual and textual encoders to encode the image and keywords and employ a language model-based decoder to generate the product description. However, the generated description is often inaccurate and generic since same-category products have similar copy-writings, and optimizing the overall framework on large-scale samples makes models concentrate on common words yet ignore the product features. To alleviate the issue, we present a simple and effective Multimodal In-Context Tuning approach, named ModICT, which introduces a similar product sample as the reference and utilizes the in-context learning capability of language models to produce the description. During training, we keep the visual encoder and language model frozen, focusing on optimizing the modules responsible for creating multimodal in-context references and dynamic prompts. This approach preserves the language generation prowess of large language models (LLMs), facilitating a substantial increase in description diversity. To assess the effectiveness of ModICT across various language model scales and types, we collect data from three distinct product categories within the E-commerce domain. Extensive experiments demonstrate that ModICT significantly improves the accuracy (by up to 3.3% on Rouge-L) and diversity (by up to 9.4% on D-5) of generated results compared to conventional methods. Our findings underscore the potential of ModICT as a valuable tool for enhancing automatic generation of product descriptions in a wide range of applications. Code is at: https://github.com/HITsz-TMG/Multimodal-In-Context-Tuning


title: PI-CoF: A Bilevel Optimization Framework for Solving Active Learning Problems using Physics-Information

abstract: Physics informed neural networks (PINNs) have recently been proposed as surrogate models for solving process optimization problems. However, in an active learning setting collecting enough data for reliably training PINNs poses a challenge. This study proposes a broadly applicable method for incorporating physics information into existing machine learning (ML) models of any type. The proposed method - referred to as PI-CoF for Physics-Informed Correction Factors - introduces additive or multiplicative correction factors for pointwise inference, which are identified by solving a regularized unconstrained optimization problem for reconciliation of physics information and ML model predictions. When ML models are used in an optimization context, using the proposed approach translates into a bilevel optimization problem, where the reconciliation problem is solved as an inner problem each time before evaluating the objective and constraint functions of the outer problem. The utility of the proposed approach is demonstrated through a numerical example, emphasizing constraint satisfaction in a safe Bayesian optimization (BO) setting. Furthermore, a simulation study is carried out by using PI-CoF for the real-time optimization of a fuel cell system. The results show reduced fuel consumption and better reference tracking performance when using the proposed PI-CoF approach in comparison to a constrained BO algorithm not using physics information.


title: Affective Computing for Healthcare: Recent Trends, Applications, Challenges, and Beyond

abstract: Affective computing, which aims to recognize, interpret, and understand human emotions, provides benefits in healthcare, such as improving patient care and enhancing doctor-patient communication. However, there is a noticeable absence of a comprehensive summary of recent advancements in affective computing for healthcare, which could pose difficulties for researchers entering this field. To address this, our paper aims to provide an extensive literature review of related studies published in the last five years. We begin by analyzing trends, benefits, and limitations of recent datasets and affective computing methods devised for healthcare. Subsequently, we highlight several healthcare application hotspots of current technologies that could be promising for real-world deployment. Through our analysis, we identify and discuss some ongoing challenges in the field as evidenced by the literature. Concluding with a thorough review, we further offer potential future research directions and hope our findings and insights could guide related researchers to make better contributions to the evolution of affective computing in healthcare.


title: Tunable topological phases in nanographene-based spin-1/2 alternating-exchange Heisenberg chains

abstract: Unlocking the potential of topological order within many-body spin systems has long been a central pursuit in the realm of quantum materials. Despite extensive efforts, the quest for a versatile platform enabling site-selective spin manipulation, essential for tuning and probing diverse topological phases, has persisted. Here, we utilize on-surface synthesis to construct spin-1/2 alternating-exchange Heisenberg (AH) chains[1] with antiferromagnetic couplings $J_1$ and $J_2$ by covalently linking Clar's goblets -- nanographenes each hosting two antiferromagnetically-coupled unpaired electrons[2]. Utilizing scanning tunneling microscopy, we exert atomic-scale control over the spin chain lengths, parities and exchange-coupling terminations, and probe their magnetic response by means of inelastic tunneling spectroscopy. Our investigation confirms the gapped nature of bulk excitations in the chains, known as triplons[3]. Besides, the triplon dispersion relation is successfully extracted from the spatial variation of tunneling spectral amplitudes. Furthermore, depending on the parity and termination of chains, we observe varying numbers of in-gap $S=1/2$ edge spins, enabling the determination of the degeneracy of distinct topological ground states in the thermodynamic limit-either 1, 2, or 4. By monitoring interactions between these edge spins, we identify the exponential decay of spin correlations. Our experimental findings, corroborated by theoretical calculations, present a phase-controlled many-body platform, opening promising avenues toward the development of spin-based quantum devices.

categories: cond-mat.mtrl-sci cond-mat.mes-hall cond-mat.str-el physics.chem-ph quant-ph


title: On 1-skeleton of the cut polytopes

abstract: Given an undirected graph $G = (V,E)$, the cut polytope $\mathrm{CUT}(G)$ is defined as the convex hull of the incidence vectors of all cuts in $G$. The 1-skeleton of $\mathrm{CUT}(G)$ is a graph whose vertex set is the vertex set of the polytope, and the edge set is the set of geometric edges or one-dimensional faces of the polytope. We study the diameter and the clique number of 1-skeleton of cut polytopes for several classes of graphs. These characteristics are of interest since they estimate the computational complexity of the max-cut problem for certain computational models and classes of algorithms. It is established that while the diameter of the 1-skeleton of a cut polytope does not exceed $|V|-1$ for any connected graph, the clique number varies significantly depending on the class of graphs. For trees, cacti, and almost trees (2), the clique number is linear in the dimension, whereas for complete bipartite and $k$-partite graphs, it is superpolynomial.


title: Hypercomplex structures arising from twistor spaces

abstract: A hyperk\"ahler manifold is defined as a Riemannian manifold endowed with three covariantly constant complex structures that are quaternionically related. A twistor space is characterized as a holomorphic fiber bundle $p: \mathcal{Z} \rightarrow \mathbb{CP}^1$ possesses properties such as a family of holomorphic sections whose normal bundle is $\bigoplus^{2n}\mathcal{O}(1)$, a holomorphic section of $\Lambda^2(N\mathcal{Z})\otimes p^*(\mathcal{O}(2))$ that defines a symplectic form on each fiber, and a compatible real structure. According to the Hitchin-Karlhede-Lindstr\"om-Ro\v{c}ek theorem (Comm. Math. Phys., 108(4):535-589, 1987), there exists a hyperk\"ahler metric on the parameter space $M$ for the real sections of $\mathcal{Z}$. Utilizing the Kodaira-Spencer deformation theory, we facilitate the construction of a hypercomplex structure on $M$, predicated upon more relaxed presuppositions concerning $\mathcal{Z}$. This effort enriches our understanding of the classical theorem by Hitchin-Karlhede-Lindstr\"om-Ro\v{c}ek.


title: Knowledge Graph Enhanced Large Language Model Editing

abstract: Large language models (LLMs) are pivotal in advancing natural language processing (NLP) tasks, yet their efficacy is hampered by inaccuracies and outdated knowledge. Model editing emerges as a promising solution to address these challenges. However, existing editing methods struggle to track and incorporate changes in knowledge associated with edits, which limits the generalization ability of postedit LLMs in processing edited knowledge. To tackle these problems, we propose a novel model editing method that leverages knowledge graphs for enhancing LLM editing, namely GLAME. Specifically, we first utilize a knowledge graph augmentation module to uncover associated knowledge that has changed due to editing, obtaining its internal representations within LLMs. This approach allows knowledge alterations within LLMs to be reflected through an external graph structure. Subsequently, we design a graph-based knowledge edit module to integrate structured knowledge into the model editing. This ensures that the updated parameters reflect not only the modifications of the edited knowledge but also the changes in other associated knowledge resulting from the editing process. Comprehensive experiments conducted on GPT-J and GPT-2 XL demonstrate that GLAME significantly improves the generalization capabilities of post-edit LLMs in employing edited knowledge.


title: Two-dimensional Closed-Form Analytical Model of Laterally-Excited Film Bulk Acoustic Wave Resonator Multiferroic Antennas

abstract: To overcome the physical limitations of electrically small antennas, strain-mediated magnetoelectric antennas have been studied experimentally and theoretically. However, current closed-form analytical models include solely one-dimensional approaches. This paper proposes a two-dimensional closed-form analytical model of a laterally-excited multiferroic antenna. To model thickness-shear vibrations, we propose an extended Mason model to two dimensions. This theory solves unidirectionally-coupled elastodynamics-magnetization dynamics-electrodynamics. Without using the infinitesimal dipole approximation, this model provides a closed-form solution of the radiated electromagnetic field with an explicit dependency of the antenna response on the physical parameters, enabling their optimization. Furthermore, we compare the efficiency-bandwidth product of different multiferroic antennas with Chu's limit in the Akhiezer regime, which delimits the highest achievable mechanical quality factor for acoustic resonators at GHz frequencies. We show that phonon-phonon coupling of Akhiezer damping is most likely to limit multiferroic antenna radiation, not Chu's limit. Moreover, judicious choice of materials can enhance the maximum efficiency by more than an order of magnitude.


title: A cutting plane algorithm for globally solving low dimensional k-means clustering problems

abstract: Clustering is one of the most fundamental tools in data science and machine learning, and k-means clustering is one of the most common such methods. There is a variety of approximate algorithms for the k-means problem, but computing the globally optimal solution is in general NP-hard. In this paper we consider the k-means problem for instances with low dimensional data and formulate it as a structured concave assignment problem. This allows us to exploit the low dimensional structure and solve the problem to global optimality within reasonable time for large data sets with several clusters. The method builds on iteratively solving a small concave problem and a large linear programming problem. This gives a sequence of feasible solutions along with bounds which we show converges to zero optimality gap. The paper combines methods from global optimization theory to accelerate the procedure, and we provide numerical results on their performance.


title: Constraining anisotropic universe under $f(R,T)$ theory of gravity

abstract: We try to find the possibility of a Bianchi V universe in the modified gravitational field theory of $f(R,T)$. We have considered a Lagrangian model in the connection between the trace of the energy-momentum tensor $T$ and the Ricci scalar $R$. In order to solve the field equations a power law for the scaling factor was also considered. To make a comparison of the model parameters with the observational data, we put constraints on the model under the datasets of the Hubble parameter, Baryon Acoustic Oscillations, Pantheon, joint datasets of Hubble parameter + Pantheon, and collective datasets of the Hubble parameter + Baryon Acoustic Oscillations + Pantheon. The outcomes for the Hubble parameter in the present epoch are reasonably acceptable, especially since our estimation of this $H_0$ is remarkably consistent with various recent Planck Collaboration studies that utilize the $\Lambda$-CDM model.


title: Near-Field Multiuser Beam-Training for Extremely Large-Scale MIMO Systems

abstract: Extremely large-scale multiple-input multiple-output (XL-MIMO) systems are capable of improving spectral efficiency by employing far more antennas than conventional massive MIMO at the base station (BS). However, beam training in multiuser XL-MIMO systems is challenging. To tackle these issues, we conceive a three-phase graph neural network (GNN)-based beam training scheme for multiuser XL-MIMO systems. In the first phase, only far-field wide beams have to be tested for each user and the GNN is utilized to map the beamforming gain information of the far-field wide beams to the optimal near-field beam for each user. In addition, the proposed GNN-based scheme can exploit the position-correlation between adjacent users for further improvement of the accuracy of beam training. In the second phase, a beam allocation scheme based on the probability vectors produced at the outputs of GNNs is proposed to address the above beam-direction conflicts between users. In the third phase, the hybrid TBF is designed for further reducing the inter-user interference. Our simulation results show that the proposed scheme improves the beam training performance of the benchmarks. Moreover, the performance of the proposed beam training scheme approaches that of an exhaustive search, despite requiring only about 7% of the pilot overhead.


title: User-LLM: Efficient LLM Contextualization with User Embeddings

abstract: Large language models (LLMs) have revolutionized natural language processing. However, effectively incorporating complex and potentially noisy user interaction data remains a challenge. To address this, we propose User-LLM, a novel framework that leverages user embeddings to contextualize LLMs. These embeddings, distilled from diverse user interactions using self-supervised pretraining, capture latent user preferences and their evolution over time. We integrate these user embeddings with LLMs through cross-attention and soft-prompting, enabling LLMs to dynamically adapt to user context. Our comprehensive experiments on MovieLens, Amazon Review, and Google Local Review datasets demonstrate significant performance gains across various tasks. Notably, our approach outperforms text-prompt-based contextualization on long sequence tasks and tasks that require deep user understanding while being computationally efficient. We further incorporate Perceiver layers to streamline the integration between user encoders and LLMs, reducing computational demands.


title: Approximation and estimation of scale functions for spectrally negative Levy processes

abstract: The scale function holds significant importance within the fluctuation theory of Levy processes, particularly in addressing exit problems. However, its definition is established through the Laplace transform, thereby lacking explicit representations in general. This paper introduces a novel series representation for this scale function, employing Laguerre polynomials to construct a uniformly convergent approximate sequence. Additionally, we derive statistical inference based on specific discrete observations, presenting estimators of scale functions that are asymptotically normal.


title: Trapped Water on Silicates in the Laboratory and in Astrophysical Environments

abstract: Existence of strongly bound water molecules on silicate surfaces, above the desorption temperature of water ice, has been first predicted by computational studies and recently demonstrated by laboratory experiments. Such trapped water may be present in various astrophysical environments and there is now evidence for its presence in the diffuse interstellar medium and in extraterrestrial particles. We present here new results of a laboratory study of the phenomenon of trapping (strong bonding) of water molecules by silicates. We show that the efficiency of trapping is strongly dependent on the properties and composition of the surface. Our results point out that the presence of trapped water should be due to the hydrophilic properties of the silicate surface and that the nature of trapping is physical (physisorption rather than chemisorption). We demonstrate that water can be trapped on silicates up to the temperatures of about 470 K, which speaks for the presence of wet silicate grains in the terrestrial planet formation zone in planet-forming disks. Studying the thermal and UV stability of trapped water, we conclude that the detection of trapped water in the diffuse ISM speaks for its efficient continuous formation. We discuss our results as relevant to fundamental scientific questions, such as the oxygen depletion problem, the origin of water on Earth, and the formation of rocky planets.


title: A spectral condition for a graph having a strong parity factor

abstract: A graph $G$ contains a strong parity factor $F$ if for every subset $X\subseteq V(G)$ with $|X|$ even, $G$ has a spanning subgraph $F$ satisfying $\delta(F)\geq1$, $d_F(u)\equiv1$ (mod 2) for any $u\in X$, and $d_F(v)\equiv0$ (mod 2) for any $v\in V(G)\setminus X$. In this paper, we give a spectral radius condition to guarantee that a connected graph contains a strong parity factor.


title: Hybrid Reasoning Based on Large Language Models for Autonomous Car Driving

abstract: Large Language Models (LLMs) have garnered significant attention for their ability to understand text and images, generate human-like text, and perform complex reasoning tasks. However, their ability to generalize this advanced reasoning with a combination of natural language text for decision-making in dynamic situations requires further exploration. In this study, we investigate how well LLMs can adapt and apply a combination of arithmetic and common-sense reasoning, particularly in autonomous driving scenarios. We hypothesize that LLMs hybrid reasoning abilities can improve autonomous driving by enabling them to analyze detected object and sensor data, understand driving regulations and physical laws, and offer additional context. This addresses complex scenarios, like decisions in low visibility (due to weather conditions), where traditional methods might fall short. We evaluated Large Language Models (LLMs) based on accuracy by comparing their answers with human-generated ground truth inside CARLA. The results showed that when a combination of images (detected objects) and sensor data is fed into the LLM, it can offer precise information for brake and throttle control in autonomous vehicles across various weather conditions. This formulation and answers can assist in decision-making for auto-pilot systems.


title: Coding Theorems for Repetition and Superposition Codes over Binary-Input Output-Symmetric Channels

abstract: This paper is concerned with a class of low density generator matrix codes (LDGM), called repetition and superposition (RaS) codes, which have been proved to be capacity-achieving over binary-input output-symmetric (BIOS) channels in terms of bit-error rate (BER). We prove with a recently proposed framework that the RaS codes are also capacity-achieving over BIOS channels in terms of frame-error rate (FER). With this new framework, the theorem for the RaS codes can be generalized to source coding and joint source and channel coding (JSCC). In particular, we prove with this framework that the corresponding low-density parity-check (LDPC) codes, as an enlarged ensemble of quasi-cyclic LDPC (QC-LDPC) codes, can also achieve the capacity. To further improve the iterative decoding performance, we consider the convolutional RaS (Conv-RaS) code ensemble and prove it to be capacity-achieving over BIOS channels in terms of the first error event probability. The construction of Conv-RaS codes is flexible with rate (defined as the ratio of the input length to the encoding output length) ranging from less than one (typically for channel codes) to greater than one (typically for source codes), which can be implemented as a universal JSCC scheme, as confirmed by simulations.


title: Breaking the HISCO Barrier: Automatic Occupational Standardization with OccCANINE

abstract: This paper introduces a new tool, OccCANINE, to automatically transform occupational descriptions into the HISCO classification system. The manual work involved in processing and classifying occupational descriptions is error-prone, tedious, and time-consuming. We finetune a preexisting language model (CANINE) to do this automatically, thereby performing in seconds and minutes what previously took days and weeks. The model is trained on 14 million pairs of occupational descriptions and HISCO codes in 13 different languages contributed by 22 different sources. Our approach is shown to have accuracy, recall, and precision above 90 percent. Our tool breaks the metaphorical HISCO barrier and makes this data readily available for analysis of occupational structures with broad applicability in economics, economic history, and various related disciplines.


title: KorNAT: LLM Alignment Benchmark for Korean Social Values and Common Knowledge

abstract: For Large Language Models (LLMs) to be effectively deployed in a specific country, they must possess an understanding of the nation's culture and basic knowledge. To this end, we introduce National Alignment, which measures an alignment between an LLM and a targeted country from two aspects: social value alignment and common knowledge alignment. Social value alignment evaluates how well the model understands nation-specific social values, while common knowledge alignment examines how well the model captures basic knowledge related to the nation. We constructed KorNAT, the first benchmark that measures national alignment with South Korea. For the social value dataset, we obtained ground truth labels from a large-scale survey involving 6,174 unique Korean participants. For the common knowledge dataset, we constructed samples based on Korean textbooks and GED reference materials. KorNAT contains 4K and 6K multiple-choice questions for social value and common knowledge, respectively. Our dataset creation process is meticulously designed and based on statistical sampling theory and was refined through multiple rounds of human review. The experiment results of seven LLMs reveal that only a few models met our reference score, indicating a potential for further enhancement. KorNAT has received government approval after passing an assessment conducted by a government-affiliated organization dedicated to evaluating dataset quality. Samples and detailed evaluation protocols of our dataset can be found in https://huggingface.co/datasets/jiyounglee0523/KorNAT .


title: A Comprehensive Study of Multilingual Confidence Estimation on Large Language Models

abstract: The tendency of Large Language Models (LLMs) to generate hallucinations and exhibit overconfidence in predictions raises concerns regarding their reliability. Confidence or uncertainty estimations indicating the extent of trustworthiness of a model's response are essential to developing reliable AI systems. Current research primarily focuses on LLM confidence estimations in English, remaining a void for other widely used languages and impeding the global development of reliable AI applications. This paper introduces a comprehensive investigation of \textbf Multi\textbf{ling}ual \textbf{Conf}idence estimation (\textsc{MlingConf}) on LLMs. First, we introduce an elaborated and expert-checked multilingual QA dataset. Subsequently, we delve into the performance of several confidence estimation methods across diverse languages and examine how these confidence scores can enhance LLM performance through self-refinement. Extensive experiments conducted on the multilingual QA dataset demonstrate that confidence estimation results vary in different languages, and the verbalized numerical confidence estimation method exhibits the best performance among most languages over other methods. Finally, the obtained confidence scores can consistently improve performance as self-refinement feedback across various languages.


title: CODIS: Benchmarking Context-Dependent Visual Comprehension for Multimodal Large Language Models

abstract: Multimodal large language models (MLLMs) have demonstrated promising results in a variety of tasks that combine vision and language. As these models become more integral to research and applications, conducting comprehensive evaluations of their capabilities has grown increasingly important. However, most existing benchmarks fail to consider that, in certain situations, images need to be interpreted within a broader context. In this work, we introduce a new benchmark, named as CODIS, designed to assess the ability of models to use context provided in free-form text to enhance visual comprehension. Our findings indicate that MLLMs consistently fall short of human performance on this benchmark. Further analysis confirms that these models struggle to effectively extract and utilize contextual information to improve their understanding of images. This underscores the pressing need to enhance the ability of MLLMs to comprehend visuals in a context-dependent manner. View our project website at https://thunlp-mt.github.io/CODIS.


title: Convergence Acceleration of Markov Chain Monte Carlo-based Gradient Descent by Deep Unfolding

abstract: This study proposes a trainable sampling-based solver for combinatorial optimization problems (COPs) using a deep-learning technique called deep unfolding. The proposed solver is based on the Ohzeki method that combines Markov-chain Monte-Carlo (MCMC) and gradient descent, and its step sizes are trained by minimizing a loss function. In the training process, we propose a sampling-based gradient estimation that substitutes auto-differentiation with a variance estimation, thereby circumventing the failure of back propagation due to the non-differentiability of MCMC. The numerical results for a few COPs demonstrated that the proposed solver significantly accelerated the convergence speed compared with the original Ohzeki method.


title: VOOM: Robust Visual Object Odometry and Mapping using Hierarchical Landmarks

abstract: In recent years, object-oriented simultaneous localization and mapping (SLAM) has attracted increasing attention due to its ability to provide high-level semantic information while maintaining computational efficiency. Some researchers have attempted to enhance localization accuracy by integrating the modeled object residuals into bundle adjustment. However, few have demonstrated better results than feature-based visual SLAM systems, as the generic coarse object models, such as cuboids or ellipsoids, are less accurate than feature points. In this paper, we propose a Visual Object Odometry and Mapping framework VOOM using high-level objects and low-level points as the hierarchical landmarks in a coarse-to-fine manner instead of directly using object residuals in bundle adjustment. Firstly, we introduce an improved observation model and a novel data association method for dual quadrics, employed to represent physical objects. It facilitates the creation of a 3D map that closely reflects reality. Next, we use object information to enhance the data association of feature points and consequently update the map. In the visual object odometry backend, the updated map is employed to further optimize the camera pose and the objects. Meanwhile, local bundle adjustment is performed utilizing the objects and points-based covisibility graphs in our visual object mapping process. Experiments show that VOOM outperforms both object-oriented SLAM and feature points SLAM systems such as ORB-SLAM2 in terms of localization. The implementation of our method is available at https://github.com/yutongwangBIT/VOOM.git.


title: Data-driven Discovery with Large Generative Models

abstract: With the accumulation of data at an unprecedented rate, its potential to fuel scientific discovery is growing exponentially. This position paper urges the Machine Learning (ML) community to exploit the capabilities of large generative models (LGMs) to develop automated systems for end-to-end data-driven discovery -- a paradigm encompassing the search and verification of hypotheses purely from a set of provided datasets, without the need for additional data collection or physical experiments. We first outline several desiderata for an ideal data-driven discovery system. Then, through DATAVOYAGER, a proof-of-concept utilizing GPT-4, we demonstrate how LGMs fulfill several of these desiderata -- a feat previously unattainable -- while also highlighting important limitations in the current system that open up opportunities for novel ML research. We contend that achieving accurate, reliable, and robust end-to-end discovery systems solely through the current capabilities of LGMs is challenging. We instead advocate for fail-proof tool integration, along with active user moderation through feedback mechanisms, to foster data-driven scientific discoveries with efficiency and reproducibility.


title: Quantification of chirality based on electric toroidal monopole

abstract: Chirality ubiquitously appears in nature, however, its quantification remains obscure owing to the lack of microscopic description at the quantum-mechanical level. We propose a way of evaluating chirality in terms of electric toroidal monopole, a practical entity of time-reversal even pseudoscalar (parity-odd) object reflecting relevant electronic wave functions. For this purpose, we analyze a twisted methane at the quantum-mechanical level, showing that the electric toroidal monopoles become a quantitative indicator for chirality. In the twisted methane, we clarify that the handedness of chirality corresponds to the sign of the expectation value of the electric toroidal monopole, and that the most important ingredient is the modulation of the spin-dependent imaginary hopping between the hydrogen atoms, while the relativistic spin-orbit coupling within the carbon atom is irrelevant for chirality.


title: Catalogue of nearby blue and near-solar gas metallicity SDSS dwarf galaxies

abstract: A less explored aspect of dwarf galaxies is their metallicity evolution. Generally, dwarfs have lower metallicities than Hubble sequence late type galaxies but in reality, dwarfs span a wide range of metallicities with several open questions regarding the formation and evolution of the lowest and the highest metallicity dwarfs. We present a catalogue of 3459 blue, nearby, star forming dwarf galaxies extracted from SDSS DR16 including calculation of their metallicities using the mean of several calibrators. To compile our catalogue we applied redshift, absolute magnitude, stellar mass, optical diameter, and line flux signal to noise criteria. This produced a catalogue from the upper end of the dwarf galaxy stellar mass range. Our catalogued dwarfs have blue g - i colours and Hbeta equivalent widths, indicative of having undergone a recent episode of star formation, although their star formation rates (SFR) suggest only a moderate to low enhancement in star formation, similar to the SFRs in low surface brightness and evolved tidal dwarfs. While the catalogued dwarfs cover a range of metallicities, their mean metallicity is about 0.2 dex below solar metallicity, indicating relatively chemically evolved galaxies. The vast majority of the catalogue, with clean photometry, are relatively isolated dwarfs with only modest star formation rates and a narrow range of g - i colour, consistent with internally driven episodic mild bursts of star formation. The presented catalogue's robust metallicity estimates for nearby SDSS dwarf galaxies will help target future studies to understand the physical processes driving the metallicity evolution of dwarfs.


title: Overview of the VLSP 2023 -- ComOM Shared Task: A Data Challenge for Comparative Opinion Mining from Vietnamese Product Reviews

abstract: This paper presents a comprehensive overview of the Comparative Opinion Mining from Vietnamese Product Reviews shared task (ComOM), held as part of the 10$^{th}$ International Workshop on Vietnamese Language and Speech Processing (VLSP 2023). The primary objective of this shared task is to advance the field of natural language processing by developing techniques that proficiently extract comparative opinions from Vietnamese product reviews. Participants are challenged to propose models that adeptly extract a comparative "quintuple" from a comparative sentence, encompassing Subject, Object, Aspect, Predicate, and Comparison Type Label. We construct a human-annotated dataset comprising $120$ documents, encompassing $7427$ non-comparative sentences and $2468$ comparisons within $1798$ sentences. Participating models undergo evaluation and ranking based on the Exact match macro-averaged quintuple F1 score.


title: Developing a $\mu$Bq/m$^{3}$ level $^{226}$Ra concentration in water measurement system for the Jiangmen Underground Neutrino Observatory

abstract: The Jiangmen Underground Neutrino Observatory (JUNO), a 20~kton multi-purpose low background Liquid Scintillator (LS) detector, was proposed primarily to determine the neutrino mass ordering. To suppress the radioactivity from the surrounding rocks and tag cosmic muons, the JUNO central detector is submerged in a Water Cherenkov Detector (WCD). In addition to being used in the WCD, ultrapure water is used in LS filling, for which the $^{226}$Ra concentration in water needs to be less than 50~$\mu$Bq/m$^3$. To precisely measure the $^{226}$Ra concentration in water, a 6.0~$\mu$Bq/m$^3$ $^{226}$Ra concentration in water measurement system has been developed. In this paper, the detail of the measurement system as well as the $^{226}$Ra concentration measurement result in regular EWII ultrapure water will be presented.


title: Analyizing the Conjunction Fallacy as a Fact

abstract: Since the seminal paper by Tversky and Kahneman, the conjunction fallacy has been the subject of multiple debates and become a fundamental challenge for cognitive theories in decision-making. In this article, we take a rather uncommon perspective on this phenomenon. Instead of trying to explain the nature or causes of the conjunction fallacy (intensional definition), we analyze its range of factual possibilities (extensional definition). We show that the majority of research on the conjunction fallacy, according to our sample of experiments reviewed which covers literature between 1983 and 2016, has focused on a narrow part of the a priori factual possibilities, implying that explanations of the conjunction fallacy are fundamentally biased by the short scope of possibilities explored. The latter is a rather curious aspect of the research evolution in the conjunction fallacy considering that the very nature of it is motivated by extensional considerations.


title: YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information

abstract: Today's deep learning methods focus on how to design the most appropriate objective functions so that the prediction results of the model can be closest to the ground truth. Meanwhile, an appropriate architecture that can facilitate acquisition of enough information for prediction has to be designed. Existing methods ignore a fact that when input data undergoes layer-by-layer feature extraction and spatial transformation, large amount of information will be lost. This paper will delve into the important issues of data loss when data is transmitted through deep networks, namely information bottleneck and reversible functions. We proposed the concept of programmable gradient information (PGI) to cope with the various changes required by deep networks to achieve multiple objectives. PGI can provide complete input information for the target task to calculate objective function, so that reliable gradient information can be obtained to update network weights. In addition, a new lightweight network architecture -- Generalized Efficient Layer Aggregation Network (GELAN), based on gradient path planning is designed. GELAN's architecture confirms that PGI has gained superior results on lightweight models. We verified the proposed GELAN and PGI on MS COCO dataset based object detection. The results show that GELAN only uses conventional convolution operators to achieve better parameter utilization than the state-of-the-art methods developed based on depth-wise convolution. PGI can be used for variety of models from lightweight to large. It can be used to obtain complete information, so that train-from-scratch models can achieve better results than state-of-the-art models pre-trained using large datasets, the comparison results are shown in Figure 1. The source codes are at: https://github.com/WongKinYiu/yolov9.


title: A Monolithic Cybersecurity Architecture for Power Electronic Systems

abstract: Power electronic systems (PES) face significant threats from various data availability and integrity attacks, significantly affecting the performance of communication networks and power system operation. As a result, several attack detection and reconstruction techniques are deployed, which makes it a costly \& complex cybersecurity operational platform with significant room for incremental extensions for mitigation against future threats. Unlike the said traditional arrangements, our paper introduces a foundational approach by establishing a monolithic cybersecurity architecture (MCA) via incorporating semantic principles into the sampling process for distributed energy resources (DERs). This unified approach concurrently compensates for the intrusion challenges posed by cyber attacks by reconstructing signals using the dynamics of the inner control layer. This reconstruction considers essential semantic attributes, like Priority, Freshness, and Relevance to ensure resilient dynamic performance. Hence, the proposed scheme promises a generalized route to concurrently tackle a global set of cyber attacks in elevating the resilience of PES. Finally, rigorous validation on a modified IEEE 69-bus distribution system and a real-world South California Edison (SCE) 47-bus network, using OPAL-RT under diverse operating conditions, underscores its robustness, model-free design capability, scalability, and adaptability to dynamic cyber graphs and system reconfiguration.


title: Strong Linearizability using Primitives with Consensus Number 2

abstract: A powerful tool for designing complex concurrent programs is through composition with object implementations from lower-level primitives. Strongly-linearizable implementations allow to preserve hyper-properties, e.g., probabilistic guarantees of randomized programs. However, the only known wait-free strongly-linearizable implementations for many objects rely on compare&swap, a universal primitive that allows any number of processes to solve consensus. This is despite the fact that these objects have wait-free linearizable implementations from read / write primitives, which do not support consensus. This paper investigates a middle-ground, asking whether there are wait-free strongly-linearizable implementations from realistic primitives such as test&set or fetch&add, whose consensus number is 2. We show that many objects with consensus number 1 have wait-free strongly-linearizable implementations from fetch&add. We also show that several objects with consensus number 2 have wait-free or lock-free implementations from other objects with consensus number 2. In contrast, we prove that even when fetch&add, swap and test&set primitives are used, some objects with consensus number 2 do not have lock-free strongly-linearizable implementations. This includes queues and stacks, as well as relaxed variants thereof.


title: Covariant projective representations of Hilbert-Lie groups

abstract: Hilbert--Lie groups are Lie groups whose Lie algebra is a real Hilbert space whose scalar product is invariant under the adjoint action. These infinite-dimensional Lie groups are the closest relatives to compact Lie groups. Here we study unitary representations of these groups from various perspectives. First, we address norm-continuous, also called bounded, representations: they are well-known for simple groups, but the general picture is more complicated. Our first main result is a characterization of the discrete decomposability of all bounded representations in terms of boundedness of the set of coroots. We also show that bounded representations of type II and III exist if the set of coroots is unbounded. Second, we use covariance with respect to a one-parameter group of automorphisms to implement some regularity. Here we develop some perturbation theory based on half Lie groups that reduces matters to the case where a ``maximal torus'' is fixed, so that compatible weight decompositions can be studied. Third, we extend the context to projective representations which are covariant for a one-parameter group of automorphisms. Here important families of representations arise from ``bounded extremal weights'', and for these the corresponding central extensions can be determined explicitly, together with all one-parameter groups for which a covariant extension exists.


title: A Riemann-Hilbert approach to the two-component modified Camassa-Holm equation on the line

abstract: In this paper, we develop a Riemann-Hilbert approach to the Cauchy problem for the two-component modified Camassa-Holm (2-mCH) equation based on its Lax pair. Further via a series of deformations to the Riemann-Hilbert problem associated with the Cauchy problem by using the $\bar{\partial}$-generalization of Deift-Zhou steepest descent method, we obtain the long-time asymptotic approximations of the solutions of the 2-mCH equation in four space-time regions. Our results also confirm the soliton resolution conjecture and asymptotically stability of the $N$-soliton solutions for the 2-mCH equation.


title: Completely fixed point free isometry and cyclic orbifold of lattice vertex operator algebras

abstract: We continue our study of cyclic orbifolds of lattice vertex operator algebras and their full automorphism groups. We consider some special isometry $g\in O(L)$ such that $g^i$ is fixed point free on $L$ for any $1\leq i\leq |g|-1$. We show that when $L_2=\emptyset$ and $g^i$ is fixed point free on $L$ for any $1\leq i\leq |g|-1$, $V_L^{\hat{g}}$ has extra automorphisms implies either (1) the order of $g$ is a prime or (2) $L$ is isometric to the Leech lattice or some coinvariant sublattices of the Leech lattice.


title: Analysis of Bootstrap and Subsampling in High-dimensional Regularized Regression

abstract: We investigate popular resampling methods for estimating the uncertainty of statistical models, such as subsampling, bootstrap and the jackknife, and their performance in high-dimensional supervised regression tasks. We provide a tight asymptotic description of the biases and variances estimated by these methods in the context of generalized linear models, such as ridge and logistic regression, taking the limit where the number of samples $n$ and dimension $d$ of the covariates grow at a comparable fixed rate $\alpha\!=\! n/d$. Our findings are three-fold: i) resampling methods are fraught with problems in high dimensions and exhibit the double-descent-like behavior typical of these situations; ii) only when $\alpha$ is large enough do they provide consistent and reliable error estimations (we give convergence rates); iii) in the over-parametrized regime $\alpha\!<\!1$ relevant to modern machine learning practice, their predictions are not consistent, even with optimal regularization.


title: FLAME: Self-Supervised Low-Resource Taxonomy Expansion using Large Language Models

abstract: Taxonomies represent an arborescence hierarchical structure that establishes relationships among entities to convey knowledge within a specific domain. Each edge in the taxonomy signifies a hypernym-hyponym relationship. Taxonomies find utility in various real-world applications, such as e-commerce search engines and recommendation systems. Consequently, there arises a necessity to enhance these taxonomies over time. However, manually curating taxonomies with neoteric data presents challenges due to limitations in available human resources and the exponential growth of data. Therefore, it becomes imperative to develop automatic taxonomy expansion methods. Traditional supervised taxonomy expansion approaches encounter difficulties stemming from limited resources, primarily due to the small size of existing taxonomies. This scarcity of training data often leads to overfitting. In this paper, we propose FLAME, a novel approach for taxonomy expansion in low-resource environments by harnessing the capabilities of large language models that are trained on extensive real-world knowledge. LLMs help compensate for the scarcity of domain-specific knowledge. Specifically, FLAME leverages prompting in few-shot settings to extract the inherent knowledge within the LLMs, ascertaining the hypernym entities within the taxonomy. Furthermore, it employs reinforcement learning to fine-tune the large language models, resulting in more accurate predictions. Experiments on three real-world benchmark datasets demonstrate the effectiveness of FLAME in real-world scenarios, achieving a remarkable improvement of 18.5% in accuracy and 12.3% in Wu & Palmer metric over eight baselines. Furthermore, we elucidate the strengths and weaknesses of FLAME through an extensive case study, error analysis and ablation studies on the benchmarks.


title: How to Reduce Temporal Cliques to Find Sparse Spanners

abstract: Many real-world networks, such as transportation or trade networks, are dynamic in the sense that the edge set may change over time, but these changes are known in advance. This behavior is captured by the temporal graphs model, which has recently become a trending topic in theoretical computer science. A core open problem in the field is to prove the existence of linear-size temporal spanners in temporal cliques, i.e., sparse subgraphs of complete temporal graphs that ensure all-pairs reachability via temporal paths. So far, the best known result is the existence of temporal spanners with $\mathcal{O}(n\log n)$ many edges. We present significant progress towards proving that linear-size temporal spanners exist in all temporal cliques. We adapt techniques used in previous works and heavily expand and generalize them to provide a simpler and more intuitive proof of the $\mathcal{O}(n\log n)$ bound. Moreover, we use our novel approach to show that a large class of temporal cliques, called edge-pivot graphs, admit linear-size temporal spanners. To contrast this, we investigate other classes of temporal cliques that do not belong to the class of edge-pivot graphs. We introduce two such graph classes and we develop novel techniques for establishing the existence of linear temporal spanners in these graph classes as well.


title: MORE: Multi-mOdal REtrieval Augmented Generative Commonsense Reasoning

abstract: Since commonsense information has been recorded significantly less frequently than its existence, language models pre-trained by text generation have difficulty to learn sufficient commonsense knowledge. Several studies have leveraged text retrieval to augment the models' commonsense ability. Unlike text, images capture commonsense information inherently but little effort has been paid to effectively utilize them. In this work, we propose a novel Multi-mOdal REtrieval (MORE) augmentation framework, to leverage both text and images to enhance the commonsense ability of language models. Extensive experiments on the Common-Gen task have demonstrated the efficacy of MORE based on the pre-trained models of both single and multiple modalities.


title: Higher-order singular perturbation models for phase transitions

abstract: Variational models of phase transitions take into account double-well energies singularly perturbed by gradient terms, such as the Cahn-Hilliard free energy. The derivation by $\Gamma$-convergence of a sharp-interface limit for such energy is a classical result by Modica and Mortola. We consider a singular perturbation of a double-well energy by derivatives of order $k$, and show that we still can describe the limit as in the case $k=1$ with a suitable interfacial energy density, in accord with the case $k=1$ and with the case $k=2$ previously analyzed by Fonseca and Mantegazza. The main isssue is the derivation of an optimal-profile problem on the real line describing the interfacial energy density, which must be conveniently approximated by minimum problems on finite intervals with homogeneous condition on the derivatives at the endpoints up to order $k-1$. To that end a careful study must be carried on of sets where sequences of functions with equibounded energy are ``close to the wells'' and have ``small derivatives'', in terms of interpolation inequalities and energy estimates.


title: Algorithms for Claims Trading

abstract: The recent banking crisis has again emphasized the importance of understanding and mitigating systemic risk in financial networks. In this paper, we study a market-driven approach to rescue a bank in distress based on the idea of claims trading, a notion defined in Chapter 11 of the U.S. Bankruptcy Code. We formalize the idea in the context of financial networks by Eisenberg and Noe. For two given banks v and w, we consider the operation that w takes over some claims of v and in return gives liquidity to v to ultimately rescue v. We study the structural properties and computational complexity of decision and optimization problems for several variants of claims trading. When trading incoming edges of v, we show that there is no trade in which both banks v and w strictly improve their assets. We therefore consider creditor-positive trades, in which v profits strictly and w remains indifferent. For a given set C of incoming edges of v, we provide an efficient algorithm to compute payments by w that result in maximal assets of v. When the set C must also be chosen, the problem becomes weakly NP-hard. Our main result here is a bicriteria FPTAS to compute an approximate trade. The approximate trade results in nearly the optimal amount of assets of v in any exact trade. Our results extend to the case in which banks use general monotone payment functions and the emerging clearing state can be computed efficiently. In contrast, for trading outgoing edges of v, the goal is to maximize the increase in assets for the creditors of v. Notably, for these results the characteristics of the payment functions of the banks are essential. For payments ranking creditors one by one, we show NP-hardness of approximation within a factor polynomial in the network size, when the set of claims C is part of the input or not. Instead, for proportional payments, our results indicate more favorable conditions.


title: Improving Building Temperature Forecasting: A Data-driven Approach with System Scenario Clustering

abstract: Heat, Ventilation and Air Conditioning (HVAC) systems play a critical role in maintaining a comfortable thermal environment and cost approximately 40% of primary energy usage in the building sector. For smart energy management in buildings, usage patterns and their resulting profiles allow the improvement of control systems with prediction capabilities. However, for large-scale HVAC system management, it is difficult to construct a detailed model for each subsystem. In this paper, a new data-driven room temperature prediction model is proposed based on the k-means clustering method. The proposed data-driven temperature prediction approach extracts the system operation feature through historical data analysis and further simplifies the system-level model to improve generalization and computational efficiency. We evaluate the proposed approach in the real world. The results demonstrated that our approach can significantly reduce modeling time without reducing prediction accuracy.


title: Adversarial Purification and Fine-tuning for Robust UDC Image Restoration

abstract: This study delves into the enhancement of Under-Display Camera (UDC) image restoration models, focusing on their robustness against adversarial attacks. Despite its innovative approach to seamless display integration, UDC technology faces unique image degradation challenges exacerbated by the susceptibility to adversarial perturbations. Our research initially conducts an in-depth robustness evaluation of deep-learning-based UDC image restoration models by employing several white-box and black-box attacking methods. This evaluation is pivotal in understanding the vulnerabilities of current UDC image restoration techniques. Following the assessment, we introduce a defense framework integrating adversarial purification with subsequent fine-tuning processes. First, our approach employs diffusion-based adversarial purification, effectively neutralizing adversarial perturbations. Then, we apply the fine-tuning methodologies to refine the image restoration models further, ensuring that the quality and fidelity of the restored images are maintained. The effectiveness of our proposed approach is validated through extensive experiments, showing marked improvements in resilience against typical adversarial attacks.


title: UniGraph: Learning a Cross-Domain Graph Foundation Model From Natural Language

abstract: Foundation models like ChatGPT and GPT-4 have revolutionized artificial intelligence, exhibiting remarkable abilities to generalize across a wide array of tasks and applications beyond their initial training objectives. However, when this concept is applied to graph learning, a stark contrast emerges. Graph learning has predominantly focused on single-graph models, tailored to specific tasks or datasets, lacking the ability to transfer learned knowledge to different domains. This limitation stems from the inherent complexity and diversity of graph structures, along with the different feature and label spaces specific to graph data. In this paper, we present our UniGraph framework, designed to train a graph foundation model capable of generalizing to unseen graphs and tasks across diverse domains. Unlike single-graph models that use pre-computed node features of varying dimensions as input, our approach leverages Text-Attributed Graphs (TAGs) for unifying node representations. We propose a cascaded architecture of Language Models (LMs) and Graph Neural Networks (GNNs) as backbone networks with a self-supervised training objective based on Masked Graph Modeling (MGM). We introduce graph instruction tuning using Large Language Models (LLMs) to enable zero-shot prediction ability. Our comprehensive experiments across various graph learning tasks and domains demonstrate the model's effectiveness in self-supervised representation learning on unseen graphs, few-shot in-context transfer, and zero-shot transfer, even surpassing or matching the performance of GNNs that have undergone supervised training on target datasets.


title: Delving into Dark Regions for Robust Shadow Detection

abstract: Shadow detection is a challenging task as it requires a comprehensive understanding of shadow characteristics and global/local illumination conditions. We observe from our experiment that state-of-the-art deep methods tend to have higher error rates in differentiating shadow pixels from non-shadow pixels in dark regions (ie, regions with low-intensity values). Our key insight to this problem is that existing methods typically learn discriminative shadow features from the whole image globally, covering the full range of intensity values, and may not learn the subtle differences between shadow and non-shadow pixels in dark regions. Hence, if we can design a model to focus on a narrower range of low-intensity regions, it may be able to learn better discriminative features for shadow detection. Inspired by this insight, we propose a novel shadow detection approach that first learns global contextual cues over the entire image and then zooms into the dark regions to learn local shadow representations. To this end, we formulate an effective dark-region recommendation (DRR) module to recommend regions of low-intensity values, and a novel dark-aware shadow analysis (DASA) module to learn dark-aware shadow features from the recommended dark regions. Extensive experiments show that the proposed method outperforms the state-of-the-art methods on three popular shadow detection datasets. Code is available at https://github.com/guanhuankang/ShadowDetection2021.git.


title: Ordering Topological Descriptors

abstract: Recent developments in shape reconstruction and comparison call for the use of many different types of topological descriptors (persistence diagrams, Euler characteristic functions, etc.). We establish a framework that allows for quantitative comparisons of topological descriptor types and therefore may be used as a tool in more rigorously justifying choices made in applications. We then use this framework to partially order a set of six common topological descriptor types. In particular, the resulting poset gives insight into the advantages of using verbose rather than concise topological descriptors. We then provide lower bounds on the size of sets of descriptors that are complete discrete invariants of simplicial complexes, both tight and worst case. This work sets up a rigorous theory that allows for future comparisons and analysis of topological descriptor types.


title: Rings whose subrings are all Noetherian or Artinian

abstract: We study noncommutative rings whose proper subrings all satisfy the same chain condition. We show that if every proper subring of a ring $R$ is right Noetherian, then $R$ is either right Noetherian or the trivial extension of $\mathbb{Z}$ by the Pr\"ufer $p$-group for a prime $p$. We also prove that if every proper subring of $R$ is right Artinian, then $R$ is either right Artinian or $\mathbb{Z}$. For commutative rings, both results were proved by Gilmer and Heinzer in 1992. Our result for right Artinian subrings only generalises the absolute case of their commutative result. We generalise the full result (when only certain subrings are right Artinian) in the context of PI rings.


title: Learning Dual-arm Object Rearrangement for Cartesian Robots

abstract: This work focuses on the dual-arm object rearrangement problem abstracted from a realistic industrial scenario of Cartesian robots. The goal of this problem is to transfer all the objects from sources to targets with the minimum total completion time. To achieve the goal, the core idea is to develop an effective object-to-arm task assignment strategy for minimizing the cumulative task execution time and maximizing the dual-arm cooperation efficiency. One of the difficulties in the task assignment is the scalability problem. As the number of objects increases, the computation time of traditional offline-search-based methods grows strongly for computational complexity. Encouraged by the adaptability of reinforcement learning (RL) in long-sequence task decisions, we propose an online task assignment decision method based on RL, and the computation time of our method only increases linearly with the number of objects. Further, we design an attention-based network to model the dependencies between the input states during the whole task execution process to help find the most reasonable object-to-arm correspondence in each task assignment round. In the experimental part, we adapt some search-based methods to this specific setting and compare our method with them. Experimental result shows that our approach achieves outperformance over search-based methods in total execution time and computational efficiency, and also verifies the generalization of our method to different numbers of objects. In addition, we show the effectiveness of our method deployed on the real robot in the supplementary video.