title: Interference-Constrained Scheduling of a Cognitive Multi-hop Underwater Acoustic Network

abstract: This paper investigates optimal scheduling for a cognitive multi-hop underwater acoustic network with a primary user interference constraint. The network consists of primary and secondary users, with multi-hop transmission adopted for both user types to provide reliable communications. Critical characteristics of underwater acoustic channels, including significant propagation delay, distance-and-frequency dependent attenuation, half-duplex modem, and inter-hop interference, are taken into account in the design and analysis. In particular, time-slot allocation is found to be more effective than frequency-slot allocation due to the underwater channel model. The goal of the network scheduling problem is to maximize the end-to-end throughput of the overall system while limiting the throughput loss of primary users. Both centralized and decentralized approaches are considered. Partially Observable Markov Decision Processes (POMDP) framework is applied to formulate the optimization problem, and an optimal dynamic programming algorithm is derived. However, the optimal dynamic programming solution is computationally intractable. Key properties are shown for the objective function, enabling the design of approximate schemes with significant complexity reduction. Numerical results show that the proposed schemes significantly increase system throughput while maintaining the primary throughput loss constraint. Under certain traffic conditions, the throughput gain over frequency-slot allocation schemes can be as high as 50%.


title: Some remarks on selectively star-ccc spaces

abstract: In this paper, the author represent a unification and extension of concepts previously studied by several authors. By establish connections between the chain condition, selectively star-ccc properties and star-Lindel\"of properties, the author provide that selectively $3$-star-ccc equals weakly strongly star-Lindel\"of for normal spaces, which gives a negative answer to Question 4.10 raised by Xuan and Song in \cite{xuan2}, and use a different method from Xuan and Song to provide that the CCC implies selectively $2$-star-ccc, which gives a positive answer to Problem 4.4 in \cite{bal}. Finally, an example is given to distinguish these properties.


title: What Explains Teachers' Trust of AI in Education across Six Countries?

abstract: With growing expectations to use AI-based educational technology (AI-EdTech) to improve students' learning outcomes and enrich teaching practice, teachers play a central role in the adoption of AI-EdTech in classrooms. Teachers' willingness to accept vulnerability by integrating technology into their everyday teaching practice, that is, their trust in AI-EdTech, will depend on how much they expect it to benefit them versus how many concerns it raises for them. In this study, we surveyed 508 K-12 teachers across six countries on four continents to understand which teacher characteristics shape teachers' trust in AI-EdTech, and its proposed antecedents, perceived benefits and concerns about AI-EdTech. We examined a comprehensive set of characteristics including demographic and professional characteristics (age, gender, subject, years of experience, etc.), cultural values (Hofstede's cultural dimensions), geographic locations (Brazil, Israel, Japan, Norway, Sweden, USA), and psychological factors (self-efficacy and understanding). Using multiple regression analysis, we found that teachers with higher AI-EdTech self-efficacy and AI understanding perceive more benefits, fewer concerns, and report more trust in AI-EdTech. We also found geographic and cultural differences in teachers' trust in AI-EdTech, but no demographic differences emerged based on their age, gender, or level of education. The findings provide a comprehensive, international account of factors associated with teachers' trust in AI-EdTech. Efforts to raise teachers' understanding of, and trust in AI-EdTech, while considering their cultural values are encouraged to support its adoption in K-12 education.


title: A unified framework combining coherent compounding, harmonic imaging and angular coherence for simultaneous high-quality B-mode and tissue Doppler in ultrafast echocardiography

abstract: Various methods have been proposed to enhance image quality in ultrafast ultrasound. Coherent compounding can improve image quality using multiple steered diverging transmits when motion occurring between transmits is corrected for. Harmonic imaging, a standard technique in conventional focused echocardiography, has been adapted for ultrafast imaging, reducing clutter. Coherence-based approaches have also been shown to increase contrast in clinical settings by enhancing signals from coherent echoes and reducing clutter. Herein, we introduce a simple, unified framework that combines motion-correction, harmonic imaging, and angular-coherence, showing for the first time that their benefits can be combined in real-time. Validation was conducted through in vitro testing on a spinning disk model and in vivo on 4 volunteers. In vitro results confirmed the unified framework capability to achieve high contrast in large-motion contexts up to 17 cm/s. In vivo testing highlighted proficiency in generating images of high quality during low and high tissue velocity phases of the cardiac cycle. Specifically, during ventricular filling, the unified framework increased the gCNR from 0.47 to 0.87 when compared against coherent compounding.


title: CLAMP: Contrastive LAnguage Model Prompt-tuning

abstract: Large language models (LLMs) have emerged as powerful general-purpose interfaces for many machine learning problems. Recent work has adapted LLMs to generative visual tasks like image captioning, visual question answering, and visual chat, using a relatively small amount of instruction-tuning data. In this paper, we explore whether modern LLMs can also be adapted to classifying an image into a set of categories. First, we evaluate multimodal LLMs that are tuned for generative tasks on zero-shot image classification and find that their performance is far below that of specialized models like CLIP. We then propose an approach for light fine-tuning of LLMs using the same contrastive image-caption matching objective as CLIP. Our results show that LLMs can, indeed, achieve good image classification performance when adapted this way. Our approach beats state-of-the-art mLLMs by 13% and slightly outperforms contrastive learning with a custom text model, while also retaining the LLM's generative abilities. LLM initialization appears to particularly help classification in domains under-represented in the visual pre-training data.


title: Ground-State Phase Diagram of (1/2,1/2,1) Mixed Diamond Chains

abstract: The ground-state phases of mixed diamond chains with ($S, \tau^{(1)}, \tau^{(2)})=(1/2,1/2,1)$, where $S$ is the magnitude of vertex spins, and $\tau^{(1)}$ and $\tau^{(2)}$ are those of apical spins, are investigated. The two apical spins in each unit cell are coupled by an exchange coupling $\lambda$. The vertex spins are coupled with the top and bottom apical spins by exchange couplings $1+\delta$ and $1-\delta$, respectively. Although this model has an infinite number of local conservation laws for $\delta=0$, they are lost for finite $\delta$. The ground-state phase diagram is determined using the numerical exact diagonalization and DMRG method in addition to the analytical approximations in various limiting cases. The phase diagram consists of a nonmagnetic phase and several kinds of ferrimagnetic phases. We find two different ferrimagnetic phases without spontaneous translational symmetry breakdown. It is also found that the quantized ferrimagnetic phases with large spatial periodicities present for $\delta=0$ are easily destroyed by small $\delta$ and replaced by a partial ferrimagnetic phase. The nonmagnetic phase is considered to be a gapless Tomonaga-Luttinger liquid phase based on the recently extended Lieb-Schultz-Mattis theorem to the site-reflection invariant spin chains and numerical diagonalization results.


title: Cooperative vs. Teleoperation Control of the Steady Hand Eye Robot with Adaptive Sclera Force Control: A Comparative Study

abstract: A surgeon's physiological hand tremor can significantly impact the outcome of delicate and precise retinal surgery, such as retinal vein cannulation (RVC) and epiretinal membrane peeling. Robot-assisted eye surgery technology provides ophthalmologists with advanced capabilities such as hand tremor cancellation, hand motion scaling, and safety constraints that enable them to perform these otherwise challenging and high-risk surgeries with high precision and safety. Steady-Hand Eye Robot (SHER) with cooperative control mode can filter out surgeon's hand tremor, yet another important safety feature, that is, minimizing the contact force between the surgical instrument and sclera surface for avoiding tissue damage cannot be met in this control mode. Also, other capabilities, such as hand motion scaling and haptic feedback, require a teleoperation control framework. In this work, for the first time, we implemented a teleoperation control mode incorporated with an adaptive sclera force control algorithm using a PHANTOM Omni haptic device and a force-sensing surgical instrument equipped with Fiber Bragg Grating (FBG) sensors attached to the SHER 2.1 end-effector. This adaptive sclera force control algorithm allows the robot to dynamically minimize the tool-sclera contact force. Moreover, for the first time, we compared the performance of the proposed adaptive teleoperation mode with the cooperative mode by conducting a vessel-following experiment inside an eye phantom under a microscope.


title: GaussianHead: High-fidelity Head Avatars with Learnable Gaussian Derivation

abstract: Constructing vivid 3D head avatars for given subjects and realizing a series of animations on them is valuable yet challenging. This paper presents GaussianHead, which models the actional human head with anisotropic 3D Gaussians. In our framework, a motion deformation field and multi-resolution tri-plane are constructed respectively to deal with the head's dynamic geometry and complex texture. Notably, we impose an exclusive derivation scheme on each Gaussian, which generates its multiple doppelgangers through a set of learnable parameters for position transformation. With this design, we can compactly and accurately encode the appearance information of Gaussians, even those fitting the head's particular components with sophisticated structures. In addition, an inherited derivation strategy for newly added Gaussians is adopted to facilitate training acceleration. Extensive experiments show that our method can produce high-fidelity renderings, outperforming state-of-the-art approaches in reconstruction, cross-identity reenactment, and novel view synthesis tasks. Our code is available at: https://github.com/chiehwangs/gaussian-head.


title: Rational Spherical Triangles

abstract: A rational spherical triangle is a triangle on the unit sphere such that the lengths of its three sides and its area are rational multiples of $\pi$. Little and Coxeter have given examples of rational spherical triangles in 1980s. In this work, we are interested in determining all the rational spherical triangles. We introduce a conjecture on the solutions to a trigonometric Diophantine equation. An implication of the conjecture is that the only rational spherical triangles are the ones given by Little and Coxeter. We prove some partial results towards the conjecture.


title: Robust Streaming, Sampling, and a Perspective on Online Learning

abstract: In this work we present an overview of statistical learning, followed by a survey of robust streaming techniques and challenges, culminating in several rigorous results proving the relationship that we motivate and hint at throughout the journey. Furthermore, we unify often disjoint theorems in a shared framework and notation to clarify the deep connections that are discovered. We hope that by approaching these results from a shared perspective, already aware of the technical connections that exist, we can enlighten the study of both fields and perhaps motivate new and previously unconsidered directions of research.


title: Continuity of functions in complex Sobolev spaces

abstract: We study the continuity regularity of functions in the complex Sobolev spaces. As applications, we obtain Hermitian generalizations of a recent result due Guedj-Guenancia-Zeriahi on the diameters of Kaehler metrics.


title: Comparing numerical relativity and perturbation theory waveforms for a non-spinning equal-mass binary

abstract: Past studies have empirically demonstrated a surprising agreement between gravitational waveforms computed using adiabatic-driven-inspiral point-particle black hole perturbation theory (ppBHPT) and numerical relativity (NR) following a straightforward calibration step, sometimes referred to as $\alpha$-$\beta$ scaling. Specifically focusing on the quadrupole mode, this calibration technique necessitates only two time-independent parameters to scale the overall amplitude and time coordinate. In this article, part of a special issue, we investigate this scaling for non-spinning binaries at the equal mass limit. Even without calibration, NR and ppBHPT waveforms exhibit an unexpected degree of similarity after accounting for different mass scale definitions. Post-calibration, good agreement between ppBHPT and NR waveforms extends nearly up to the point of the merger. We also assess the breakdown of the time-independent assumption of the scaling parameters, shedding light on current limitations and suggesting potential generalizations for the $\alpha$-$\beta$ scaling technique.


title: Near-real-time monitoring of global ocean carbon sink

abstract: Mitigation of climate change will highly rely on a carbon emission trajectory that achieves carbon neutrality by the 2050s. The ocean plays a critical role in modulating climate change by sequestering CO2 from the atmosphere. Relying on the multidisciplinary cutting-edge methodologies and technologies, the near-real-time monitoring of global ocean carbon sinks from January 2022 to July 2023 aims to provide the world's latest assessment of monthly and gridded global ocean carbon sinks based on machine learning and other data science technologies. The project will help us find a robust route to deal with climate change, which will significantly promote the ocean carbon sinks research and will be of great interest for policy makers, researchers, and the public. This research aims to build up an integrated machine learning framework and methodology for assessing global ocean carbon neutral process; development of near-real-time dataset; development of visualization platform; research papers published in international prestigious journals; an executive report openly accessible to policy makers and the public.


title: J-Net: Improved U-Net for Terahertz Image Super-Resolution

abstract: Terahertz (THz) waves are electromagnetic waves in the 0.1 to 10 THz frequency range, and THz imaging is utilized in a range of applications, including security inspections, biomedical fields, and the non-destructive examination of materials. However, THz images have low resolution due to the long wavelength of THz waves. Therefore, improving the resolution of THz images is one of the current hot research topics. We propose a novel network architecture called J-Net which is improved version of U-Net to solve the THz image super-resolution. It employs the simple baseline blocks which can extract low resolution (LR) image features and learn the mapping of LR images to highresolution (HR) images efficiently. All training was conducted using the DIV2K+Flickr2K dataset, and we employed the peak signal-to-noise ratio (PSNR) for quantitative comparison. In our comparisons with other THz image super-resolution methods, JNet achieved a PSNR of 32.52 dB, surpassing other techniques by more than 1 dB. J-Net also demonstrates superior performance on real THz images compared to other methods. Experiments show that the proposed J-Net achieves better PSNR and visual improvement compared with other THz image super-resolution methods.


title: On the Effectiveness of Large Language Models in Domain-Specific Code Generation

abstract: Large language models (LLMs) such as ChatGPT have shown remarkable capabilities in code generation. Despite the great achievement, they rely on enormous training data to acquire a broad spectrum of open-domain knowledge. Besides, their evaluation revolves around open-domain benchmarks like HumanEval, which primarily consist of programming contests. Therefore, it is hard to fully characterize the intricacies and challenges associated with particular domains (e.g., web, game, and math). In this paper, we conduct an in-depth study of the LLMs in domain-specific code generation. Our results demonstrate that LLMs exhibit sub-optimal performance in generating domain-specific code, due to their limited proficiency in utilizing domain-specific libraries. We further observe that incorporating API knowledge as prompts can empower LLMs to generate more professional code. Based on these findings, we further investigate how to efficiently incorporate API knowledge into the code generation process. We experiment with three strategies for incorporating domain knowledge, namely, external knowledge inquirer, chain-of-thought prompting, and chain-of-thought fine-tuning. We refer to these strategies as a new code generation approach called DomCoder. Experimental results show that all strategies of DomCoder lead to improvement in the effectiveness of domain-specific code generation under certain settings. The results also show that there is still ample room for further improvement, based on which we suggest possible future works.


title: SequencePAR: Understanding Pedestrian Attributes via A Sequence Generation Paradigm

abstract: Current pedestrian attribute recognition (PAR) algorithms are developed based on multi-label or multi-task learning frameworks, which aim to discriminate the attributes using specific classification heads. However, these discriminative models are easily influenced by imbalanced data or noisy samples. Inspired by the success of generative models, we rethink the pedestrian attribute recognition scheme and believe the generative models may perform better on modeling dependencies and complexity between human attributes. In this paper, we propose a novel sequence generation paradigm for pedestrian attribute recognition, termed SequencePAR. It extracts the pedestrian features using a pre-trained CLIP model and embeds the attribute set into query tokens under the guidance of text prompts. Then, a Transformer decoder is proposed to generate the human attributes by incorporating the visual features and attribute query tokens. The masked multi-head attention layer is introduced into the decoder module to prevent the model from remembering the next attribute while making attribute predictions during training. Extensive experiments on multiple widely used pedestrian attribute recognition datasets fully validated the effectiveness of our proposed SequencePAR. The source code and pre-trained models will be released at https://github.com/Event-AHU/OpenPAR.


title: A fluid-particle decomposition approach to matching market design for crowdsourced delivery systems

abstract: This paper considers a crowdsourced delivery (CSD) system that effectively utilizes the existing trips to fulfill parcel delivery as a matching problem between CSD drivers and delivery tasks. This matching problem has two major challenges. First, it is a large-scale combinatorial optimization problem that is hard to solve in a reasonable computational time. Second, the evaluation of the objective function for socially optimal matching contains the utility of drivers for performing the tasks, which is generally unobservable private information. To address these challenges, this paper proposes a hierarchical distribution mechanism of CSD tasks that decomposes the matching problem into the task partition (master problem) and individual task-driver matching within smaller groups of drivers (sub-problems). We incorporate an auction mechanism with truth-telling and efficiency into the sub-problems so that the drivers' perceived utilities are revealed through their bids. Furthermore, we formulate the master problem as a fluid model based on continuously approximated decision variables. By exploiting the random utility framework, we analytically represent the objective function of the problem using continuous variables, without explicitly knowing the drivers' utilities. The numerical experiment shows that the proposed approach solved large-scale matching problems at least 100 times faster than a naive LP solver and approximated the original objective value with errors of less than 1%.


title: Voice-Based Smart Assistant System for Vehicles using RASA

abstract: Conversational AIs, or chatbots, mimic human speech when conversing. Smart assistants facilitate the automation of several tasks that needed human intervention earlier. Because of their accuracy, absence of dependence on human resources, and accessibility around the clock, chatbots can be employed in vehicles too. Due to people's propensity to divert their attention away from the task of driving while engaging in other activities like calling, playing music, navigation, and getting updates on the weather forecast and latest news, road safety has declined and accidents have increased as a result. It would be advantageous to automate these tasks using voice commands rather than carrying them out manually. This paper focuses on the development of a voice-based smart assistance application for vehicles based on the RASA framework. The smart assistant provides functionalities like navigation, communication via calls, getting weather forecasts and the latest news updates, and music that are completely voice-based in nature.


title: Enriching meta-analyses through scoping review, bibliometrics, and alternative impact metrics: Visualizing study characteristics, hidden risk of bias, societal influence, and research translation

abstract: We present a framework consisting of three approaches that can enhance meta-analyses: 1) scoping reviews (evidence map), 2) bibliometrics, and 3) alternative impact metrics. These three "enrichment" approaches facilitate the research synthesis of both quantitative and qualitative evidence, along with academic and non-academic influences. While the meta-analysis yields quantitative insights (e.g., overall estimates), the enrichment analyses provide user-friendly summaries of qualitative information on the evidence base. Scoping reviews can visualize study characteristics, unravelling knowledge gaps and methodological differences. Bibliometric analysis offers a visual assessment of the non-independent evidence, such as hyper-dominant authors and countries, and funding sources, potentially informing the risk of bias. Impact metric analysis employs alternative metrics to gauge societal influence and research translation (e.g., policy and patent citations) of studies in the meta-analysis. To illustrate the application of this framework, we provide sample visualizations and R code.


title: TMSR: Tiny Multi-path CNNs for Super Resolution

abstract: In this paper, we proposed a tiny multi-path CNN-based Super-Resolution (SR) method, called TMSR. We mainly refer to some tiny CNN-based SR methods, under 5k parameters. The main contribution of the proposed method is the improved multi-path learning and self-defined activated function. The experimental results show that TMSR obtains competitive image quality (i.e. PSNR and SSIM) compared to the related works under 5k parameters.


title: A text-dependent speaker verification application framework based on Chinese numerical string corpus

abstract: Researches indicate that text-dependent speaker verification (TD-SV) often outperforms text-independent verification (TI-SV) in short speech scenarios. However, collecting large-scale fixed text speech data is challenging, and as speech length increases, factors like sentence rhythm and pauses affect TDSV's sensitivity to text sequence. Based on these factors, We propose the hypothesis that strategies such as more fine-grained pooling methods on time scales and decoupled representations of speech speaker embedding and text embedding are more suitable for TD-SV. We have introduced an end-to-end TD-SV system based on a dataset comprising longer Chinese numerical string texts. It contains a text embedding network, a speaker embedding network, and back-end fusion. First, we recorded a dataset consisting of long Chinese numerical text named SHAL, which is publicly available on the Open-SLR website. We addressed the issue of dataset scarcity by augmenting it using Tacotron2 and HiFi-GAN. Next, we introduced a dual representation of speech with text embedding and speaker embedding. In the text embedding network, we employed an enhanced Transformer and introduced a triple loss that includes text classification loss, CTC loss, and decoder loss. For the speaker embedding network, we enhanced a sliding window attentive statistics pooling (SWASP), combined with attentive statistics pooling (ASP) to create a multi-scale pooling method. Finally, we fused text embedding and speaker embedding. Our pooling methods achieved an equal error rate (EER) performance improvement of 49.2% on Hi-Mia and 75.0% on SHAL, respectively.


title: Enhancing data-limited assessments with random effects: A case study on Korea chub mackerel (Scomber japonicus)

abstract: In a state-space framework, temporal variations in fishery-dependent processes can be modeled as random effects. This modeling flexibility makes state-space models (SSMs) powerful tools for data-limited assessments. Though SSMs enable the model-based inference of the unobserved processes, their flexibility can lead to overfitting and non-identifiability issues. To address these challenges, we developed a suite of state-space length-based age-structured models and applied them to the Korean chub mackerel (Scomber japonicus) stock. Our research demonstrated that incorporating temporal variations in fishery-dependent processes can rectify model mis-specification but may compromise robustness, which can be diagnosed through a series of model checking processes. To tackle non-identifiability, we used a non-degenerate estimator, implementing a gamma distribution as a penalty for the standard deviation parameters of observation errors. This penalty function enabled the simultaneous estimation of both process and observation error variances with minimal bias, a notably challenging task in SSMs. These results highlight the importance of model checking and the effectiveness of the penalized approach in estimating SSMs. Additionally, we discussed novel assessment outcomes for the mackerel stock.


title: Lascoux expansion of the product of a Lascoux and a stable Grothendieck

abstract: This paper gives a tableau formula for expanding the product of a Lascoux polynomial and a stable Grothendieck polynomial into Lascoux polynomials. Lascoux and stable Grothendieck polynomials are inhomogeneous analogues of key polynomials and Stanley symmetric functions, respectively. Our formula refines the K-theoretic Littlewood-Richardson rule of Buch and extends the key expansion of key times Schur established by Haglund, Luoto, Mason, and van Willigenburg. Our proof is combinatorial, relying heavily on a novel row insertion algorithm of Huang, Shimozono and Yu.


title: Characterizing Large Language Model Geometry Solves Toxicity Detection and Generation

abstract: Large Language Models~(LLMs) drive current AI breakthroughs despite very little being known about their internal representations, e.g., how to extract a few informative features to solve various downstream tasks. To provide a practical and principled answer, we propose to characterize LLMs from a geometric perspective. We obtain in closed form (i) the intrinsic dimension in which the Multi-Head Attention embeddings are constrained to exist and (ii) the partition and per-region affine mappings of the per-layer feedforward networks. Our results are informative, do not rely on approximations, and are actionable. First, we show that, motivated by our geometric interpretation, we can bypass Llama$2$'s RLHF by controlling its embedding's intrinsic dimension through informed prompt manipulation. Second, we derive $7$ interpretable spline features that can be extracted from any (pre-trained) LLM layer, providing a rich abstract representation of their inputs. Those features alone ($224$ for Mistral-7B/Llama$2$-7B and $560$ for Llama$2$-70B) are sufficient to help solve toxicity detection, infer the domain of the prompt, and even tackle the Jigsaw challenge, which aims at characterizing the type of toxicity of various prompts. Our results demonstrate how, even in large-scale regimes, exact theoretical results can answer practical questions in language models. Code: \url{https://github.com/RandallBalestriero/SplineLLM}.


title: A simple stacked ensemble machine learning model to predict naturalized catchment hydrology and allocation status

abstract: New Zealand legislation requires that Regional Councils set limits for water resource usage to manage the effects of abstractions in over-allocated catchments. We propose a simple stacked ensemble machine learning model to predict the probable naturalized hydrology and allocation status across 317 anthropogenically stressed gauged catchments and across 18,612 ungauged river reaches in Otago. The training and testing of ensemble machine learning models provides unbiased results characterized as very good (R2 > 0.8) to extremely good (R2 > 0.9) when predicting naturalized mean annual low flow and Mean flow. Statistical 5-fold stacking identifies varying levels of risk for managing water-resource sustainability in over-allocated catchments; for example, at the respective 5th, 25th, 50th, 75th, and 95th percentiles the number of overallocated catchments are 73, 57, 44, 23, and 22. The proposed model can be applied to inform sustainable stream management in other regional catchments across New Zealand and worldwide.


title: Adaptive Confidence Threshold for ByteTrack in Multi-Object Tracking

abstract: We investigate the application of ByteTrack in the realm of multiple object tracking. ByteTrack, a simple tracking algorithm, enables the simultaneous tracking of multiple objects by strategically incorporating detections with a low confidence threshold. Conventionally, objects are initially associated with high confidence threshold detections. When the association between objects and detections becomes ambiguous, ByteTrack extends the association to lower confidence threshold detections. One notable drawback of the existing ByteTrack approach is its reliance on a fixed threshold to differentiate between high and low-confidence detections. In response to this limitation, we introduce a novel and adaptive approach. Our proposed method entails a dynamic adjustment of the confidence threshold, leveraging insights derived from overall detections. Through experimentation, we demonstrate the effectiveness of our adaptive confidence threshold technique while maintaining running time compared to ByteTrack.


title: Experimental Optimal Quantum State Estimation with Genuine Three-copy Collective Measurements

abstract: Nonclassical phenomena tied to entangled states are focuses of foundational studies and powerful resources in many applications. By contrast, the counterparts on quantum measurements are still poorly understood. Notably, genuine multipartite nonclassicality is barely discussed, not to say experimental realization. Here we experimentally demonstrate the power of genuine tripartite nonclassicality in quantum measurements based on a simple estimation problem. To this end we realize an optimal genuine three-copy collective measurement via a nine-step two-dimensional photonic quantum walk with 30 elaborately designed coin operators. Then we realize an optimal estimation protocol and achieve an unprecedented high estimation fidelity, which can beat all strategies based on restricted collective measurements by more than 11 standard deviations. These results clearly demonstrate that genuine collective measurements can extract more information than local measurements and restricted collective measurements. Our work opens the door for exploring genuine multipartite nonclassical measurements and their power in quantum information processing.


title: On the Expressive Power of Behavior Structure

abstract: Efforts toward a comprehensive description of behavior have indeed facilitated the development of representation-based approaches that utilize deep learning to capture behavioral information. As behavior complexity increases, the expressive power of these models reaches a bottleneck. We coin the term ``behavioral molecular structure" and propose a new model called the Behavioral Molecular Structure (BMS). The model characterizes behaviors at the atomic level, analogizes behavioral attributes to atoms, and concretizes interrelations at the granularity of atoms using graphs. Here, we design three different downstream tasks to test the performance of the BMS model on public datasets. Additionally, we provide a preliminary theoretical analysis demonstrating that the BMS can offer effective expressiveness for complex behaviors.


title: An End-to-End Network Pruning Pipeline with Sparsity Enforcement

abstract: Neural networks have emerged as a powerful tool for solving complex tasks across various domains, but their increasing size and computational requirements have posed significant challenges in deploying them on resource-constrained devices. Neural network sparsification, and in particular pruning, has emerged as an effective technique to alleviate these challenges by reducing model size, computational complexity, and memory footprint while maintaining competitive performance. However, many pruning pipelines modify the standard training pipeline at only a single stage, if at all. In this work, we look to develop an end-to-end training pipeline that befits neural network pruning and sparsification at all stages of training. To do so, we make use of nonstandard model parameter initialization, pre-pruning training methodologies, and post-pruning training optimizations. We conduct experiments utilizing combinations of these methods, in addition to different techniques used in the pruning step, and find that our combined pipeline can achieve significant gains over current state of the art approaches to neural network sparsification.


title: Tetrahedra tiling problem

abstract: Kedlaya, Kolpakov, Poonen, and Rubinstein classified tetrahedra all of whose dihedral angles are rational multiples of $\pi$ into two one-parameter families (a Hill family and a new family) and $59$ sporadic tetrahedra. In this paper, we consider which of them tile space; we show that every member of the Hill family, exactly one member of the new family, and at most $40$ sporadic tetrahedra tile space. As a corollary, we disprove the converse of Debrunner's theorem, showing that not all Dehn invariant zero tetrahedra tile space.


title: Quantum Polar Metric Learning: Efficient Classically Learned Quantum Embeddings

abstract: Deep metric learning has recently shown extremely promising results in the classical data domain, creating well-separated feature spaces. This idea was also adapted to quantum computers via Quantum Metric Learning(QMeL). QMeL consists of a 2 step process with a classical model to compress the data to fit into the limited number of qubits, then train a Parameterized Quantum Circuit(PQC) to create better separation in Hilbert Space. However, on Noisy Intermediate Scale Quantum (NISQ) devices. QMeL solutions result in high circuit width and depth, both of which limit scalability. We propose Quantum Polar Metric Learning (QPMeL) that uses a classical model to learn the parameters of the polar form of a qubit. We then utilize a shallow PQC with $R_y$ and $R_z$ gates to create the state and a trainable layer of $ZZ(\theta)$-gates to learn entanglement. The circuit also computes fidelity via a SWAP Test for our proposed Fidelity Triplet Loss function, used to train both classical and quantum components. When compared to QMeL approaches, QPMeL achieves 3X better multi-class separation, while using only 1/2 the number of gates and depth. We also demonstrate that QPMeL outperforms classical networks with similar configurations, presenting a promising avenue for future research on fully classical models with quantum loss functions.


title: The Contemporary Art of Image Search: Iterative User Intent Expansion via Vision-Language Model

abstract: Image search is an essential and user-friendly method to explore vast galleries of digital images. However, existing image search methods heavily rely on proximity measurements like tag matching or image similarity, requiring precise user inputs for satisfactory results. To meet the growing demand for a contemporary image search engine that enables accurate comprehension of users' search intentions, we introduce an innovative user intent expansion framework. Our framework leverages visual-language models to parse and compose multi-modal user inputs to provide more accurate and satisfying results. It comprises two-stage processes: 1) a parsing stage that incorporates a language parsing module with large language models to enhance the comprehension of textual inputs, along with a visual parsing module that integrates an interactive segmentation module to swiftly identify detailed visual elements within images; and 2) a logic composition stage that combines multiple user search intents into a unified logic expression for more sophisticated operations in complex searching scenarios. Moreover, the intent expansion framework enables users to perform flexible contextualized interactions with the search results to further specify or adjust their detailed search intents iteratively. We implemented the framework into an image search system for NFT (non-fungible token) search and conducted a user study to evaluate its usability and novel properties. The results indicate that the proposed framework significantly improves users' image search experience. Particularly the parsing and contextualized interactions prove useful in allowing users to express their search intents more accurately and engage in a more enjoyable iterative search experience.


title: On Tuning Neural ODE for Stability, Consistency and Faster Convergence

abstract: Neural-ODE parameterize a differential equation using continuous depth neural network and solve it using numerical ODE-integrator. These models offer a constant memory cost compared to models with discrete sequence of hidden layers in which memory cost increases linearly with the number of layers. In addition to memory efficiency, other benefits of neural-ode include adaptability of evaluation approach to input, and flexibility to choose numerical precision or fast training. However, despite having all these benefits, it still has some limitations. We identify the ODE-integrator (also called ODE-solver) as the weakest link in the chain as it may have stability, consistency and convergence (CCS) issues and may suffer from slower convergence or may not converge at all. We propose a first-order Nesterov's accelerated gradient (NAG) based ODE-solver which is proven to be tuned vis-a-vis CCS conditions. We empirically demonstrate the efficacy of our approach by training faster, while achieving better or comparable performance against neural-ode employing other fixed-step explicit ODE-solvers as well discrete depth models such as ResNet in three different tasks including supervised classification, density estimation, and time-series modelling.


title: AGD: an Auto-switchable Optimizer using Stepwise Gradient Difference for Preconditioning Matrix

abstract: Adaptive optimizers, such as Adam, have achieved remarkable success in deep learning. A key component of these optimizers is the so-called preconditioning matrix, providing enhanced gradient information and regulating the step size of each gradient direction. In this paper, we propose a novel approach to designing the preconditioning matrix by utilizing the gradient difference between two successive steps as the diagonal elements. These diagonal elements are closely related to the Hessian and can be perceived as an approximation of the inner product between the Hessian row vectors and difference of the adjacent parameter vectors. Additionally, we introduce an auto-switching function that enables the preconditioning matrix to switch dynamically between Stochastic Gradient Descent (SGD) and the adaptive optimizer. Based on these two techniques, we develop a new optimizer named AGD that enhances the generalization performance. We evaluate AGD on public datasets of Natural Language Processing (NLP), Computer Vision (CV), and Recommendation Systems (RecSys). Our experimental results demonstrate that AGD outperforms the state-of-the-art (SOTA) optimizers, achieving highly competitive or significantly better predictive performance. Furthermore, we analyze how AGD is able to switch automatically between SGD and the adaptive optimizer and its actual effects on various scenarios. The code is available at https://github.com/intelligent-machine-learning/dlrover/tree/master/atorch/atorch/optimizers.


title: RiskBench: A Scenario-based Benchmark for Risk Identification

abstract: Intelligent driving systems aim to achieve a zero-collision mobility experience, requiring interdisciplinary efforts to enhance safety performance. This work focuses on risk identification, the process of identifying and analyzing risks stemming from dynamic traffic participants and unexpected events. While significant advances have been made in the community, the current evaluation of different risk identification algorithms uses independent datasets, leading to difficulty in direct comparison and hindering collective progress toward safety performance enhancement. To address this limitation, we introduce \textbf{RiskBench}, a large-scale scenario-based benchmark for risk identification. We design a scenario taxonomy and augmentation pipeline to enable a systematic collection of ground truth risks under diverse scenarios. We assess the ability of ten algorithms to (1) detect and locate risks, (2) anticipate risks, and (3) facilitate decision-making. We conduct extensive experiments and summarize future research on risk identification. Our aim is to encourage collaborative endeavors in achieving a society with zero collisions. We have made our dataset and benchmark toolkit publicly on the project page: https://hcis-lab.github.io/RiskBench/


title: Feedback Cooling of an Insulating High-Q Diamagnetically Levitated Plate

abstract: Levitated systems in vacuum have many potential applications ranging from new types of inertial and magnetic sensors through to fundamental issues in quantum science, the generation of massive Schrodinger cats, and the connections between gravity and quantum physics. In this work, we demonstrate the passive, diamagnetic levitation of a centimeter-sized massive oscillator which is fabricated using a novel method that ensures that the material, though highly diamagnetic, is an electrical insulator. By chemically coating a powder of microscopic graphite beads with silica and embedding the coated powder in high-vacuum compatible wax, we form a centimeter-sized thin square plate which magnetically levitates over a checkerboard magnet array. The insulating coating reduces eddy damping by almost an order of magnitude compared to uncoated graphite with the same particle size. These plates exhibit a different equilibrium orientation to pyrolytic graphite due to their isotropic magnetic susceptibility. We measure the motional quality factor to be Q~1.58*10^5 for an approximately centimeter-sized composite resonator with a mean particle size of 12 microns. Further, we apply delayed feedback to cool the vertical motion of frequency ~19 Hz from room temperature to 320 millikelvin.


title: ChatGPT as a Math Questioner? Evaluating ChatGPT on Generating Pre-university Math Questions

abstract: Mathematical questioning is crucial for assessing students problem-solving skills. Since manually creating such questions requires substantial effort, automatic methods have been explored. Existing state-of-the-art models rely on fine-tuning strategies and struggle to generate questions that heavily involve multiple steps of logical and arithmetic reasoning. Meanwhile, large language models(LLMs) such as ChatGPT have excelled in many NLP tasks involving logical and arithmetic reasoning. Nonetheless, their applications in generating educational questions are underutilized, especially in the field of mathematics. To bridge this gap, we take the first step to conduct an in-depth analysis of ChatGPT in generating pre-university math questions. Our analysis is categorized into two main settings: context-aware and context-unaware. In the context-aware setting, we evaluate ChatGPT on existing math question-answering benchmarks covering elementary, secondary, and ternary classes. In the context-unaware setting, we evaluate ChatGPT in generating math questions for each lesson from pre-university math curriculums that we crawl. Our crawling results in TopicMath, a comprehensive and novel collection of pre-university math curriculums collected from 121 math topics and 428 lessons from elementary, secondary, and tertiary classes. Through this analysis, we aim to provide insight into the potential of ChatGPT as a math questioner.


title: Universal Deoxidation of Semiconductor Substrates Assisted by Machine-Learning and Real-Time-Feedback-Control

abstract: Thin film deposition is an essential step in the semiconductor process. During preparation or loading, the substrate is exposed to the air unavoidably, which has motivated studies of the process control to remove the surface oxide before thin film deposition. Optimizing the deoxidation process in molecular beam epitaxy (MBE) for a random substrate is a multidimensional challenge and sometimes controversial. Due to variations in semiconductor materials and growth processes, the determination of substrate deoxidation temperature is highly dependent on the grower's expertise; the same substrate may yield inconsistent results when evaluated by different growers. Here, we employ a machine learning (ML) hybrid convolution and vision transformer (CNN-ViT) model. This model utilizes reflection high-energy electron diffraction (RHEED) video as input to determine the deoxidation status of the substrate as output, enabling automated substrate deoxidation under a controlled architecture. This also extends to the successful application of deoxidation processes on other substrates. Furthermore, we showcase the potential of models trained on data from a single MBE equipment to achieve high-accuracy deployment on other equipment. In contrast to traditional methods, our approach holds exceptional practical value. It standardizes deoxidation temperatures across various equipment and substrate materials, advancing the standardization research process in semiconductor preparation, a significant milestone in thin film growth technology. The concepts and methods demonstrated in this work are anticipated to revolutionize semiconductor manufacturing in optoelectronics and microelectronics industries by applying them to diverse material growth processes.

categories: cond-mat.mes-hall cs.LG cs.SY eess.IV eess.SY


title: Customize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Training

abstract: In this paper, we target the adaptive source driven 3D scene editing task by proposing a CustomNeRF model that unifies a text description or a reference image as the editing prompt. However, obtaining desired editing results conformed with the editing prompt is nontrivial since there exist two significant challenges, including accurate editing of only foreground regions and multi-view consistency given a single-view reference image. To tackle the first challenge, we propose a Local-Global Iterative Editing (LGIE) training scheme that alternates between foreground region editing and full-image editing, aimed at foreground-only manipulation while preserving the background. For the second challenge, we also design a class-guided regularization that exploits class priors within the generation model to alleviate the inconsistency problem among different views in image-driven editing. Extensive experiments show that our CustomNeRF produces precise editing results under various real scenes for both text- and image-driven settings.


title: Quantum Algorithm for Radiative Transfer Equation

abstract: The radiation transfer equation is widely used for simulating such as heat transfer in engineering, diffuse optical tomography in healthcare, and radiation hydrodynamics in astrophysics. By combining the lattice Boltzmann method, we propose a quantum algorithm for radiative transfer. This algorithm encompasses all the essential physical processes of radiative transfer: absorption, scattering, and emission. Although a sufficient number of measurements are required to precisely estimate the quantum state, and the initial encoding of the quantum state remains a challenging problem, our quantum algorithm exponentially accelerates radiative transfer calculations compared to classical algorithms. In order to verify the quantum algorithm, we perform quantum circuit simulation using IBM Qiskit Aer and find good agreement between our numerical result and the exact solution. The algorithm opens new application of fault-tolerant quantum computers for plasma engineering, telecommunications, nuclear fusion technology, healthcare and astrophysics.

categories: quant-ph astro-ph.GA physics.app-ph physics.comp-ph physics.flu-dyn


title: Evaluation of flamelet-based models for liquid ammonia combustion in a temporally evolving mixing layer

abstract: Liquid ammonia combustion can be enhanced by co-firing with small molecular fuels such as methane, and liquid ammonia will undergo flash evaporation due to its relatively low saturation pressure. These characteristics, involving the presence of multiple fuel streams, a rapid phase change process, and strong heat loss, pose challenges for flamelet modeling of liquid ammonia combustion. To address these issues, this study aims to evaluate the effectiveness of flamelet-based models for liquid ammonia combustion in a turbulent mixing layer. Specifically, the extended flamelet/progress variable (E-FPV), extended flamelet-generated manifolds (E-FGM), and extended hybrid (E-Hybrid) models are developed and assessed. Firstly, a three-dimensional Point-Particle Direct Numerical Simulation (PP-DNS) with detailed chemistry is performed, where the turbulent flow is fully resolved, and the ammonia droplets are described by the Lagrangian method, to investigate the combustion characteristics of a liquid ammonia/methane co-fired flame and to provide state-of-the-art validation data for flamelet modeling. The PP-DNS results reveal distinct stages in the liquid ammonia/methane co-fired flame. The phase change process introduces significant heat loss due to the high latent heat of liquid ammonia. Subsequently, flamelet-based models are developed to account for the complex fuel streams, rapid phase change process, and strong local heat loss. The performance of these models is evaluated through a priori analysis by comparing the predictions with the PP-DNS results. The a priori results show that the E-FGM model outperforms the E-FPV and E-Hybrid models. This superior performance can be attributed to the rapid flash evaporation and sufficient mixing of the superheated ammonia, resulting in the dominance of the premixed combustion mode in liquid ammonia combustion.


title: A consistent derivation of soil stiffness from elastic wave speeds

abstract: Elastic wave speeds are fundamental in geomechanics and have historically been described by an analytic formula that assumes linearly elastic solid medium. Empirical relations stemming from this assumption were used to determine nonlinearly elastic stiffness relations that depend on pressure, density, and other state variables. Evidently, this approach introduces a mathematical and physical disconnect between the derivation of the analytical wave speed (and thus stiffness) and the empirically generated stiffness constants. In our study, we derive wave speeds for energy-conserving (hyperelastic) and non-energy-conserving (hypoelastic) constitutive models that have a general dependence on pressure and density. Under isotropic compression states, the analytical solutions for both models converge to previously documented empirical relations. Conversely, in the presence of shear, hyperelasticity predicts changes in the longitudinal and transverse wave speed ratio. This prediction arises from terms that ensure energy conservation in the hyperelastic model, without needing fabric to predict such an evolution, as was sometimes assumed in previous investigations. Such insights from hyperelasticity could explain the previously unaccounted-for evolution of longitudinal wave speeds in oedometric compression. Finally, the procedure used herein is general and could be extended to account for other relevant state variables of soils, such as grain-size, grain-shape, or saturation.


title: Cohomology of knotted semimetals in three dimensions

abstract: We extend the topological classification scheme of Weyl semimetals via cohomology and the Mayer-Vietoris sequence to account for nodal line semimetals with space-time inversion symmetry. These are semimetals where bands meet generally in 1-dimensional submanifolds, which can generally be knots in $\T^3$. These nodal loops have two charges, the quantized Berry phase and the $\Z_2$-monopole charge, the second related to linking numbers of nodal knots between bands. We provide a manifestly topological proof of the Weyl charge cancellation condition for the $\Z_2$ monopole charge, which is known to be the second Stiefel-Whitney class of a tubular neighbourhood surrounding a Weyl submanifold via the Mayer-Vietoris sequence.

categories: math-ph cond-mat.mes-hall math.AT math.DG math.MP


title: Optimal dividend payout with path-dependent drawdown constraint

abstract: This paper studies an optimal dividend payout problem with drawdown constraint in a Brownian motion model, where the dividend payout rate must be no less than a fixed proportion of its historical running maximum. It is a stochastic control problem, where the admissible control depends on its past values, thus is path-dependent. The related Hamilton-Jacobi-Bellman equation turns out to be a new type of two-dimensional variational inequality with gradient constraint, which has only been studied by viscosity solution technique in the literature. In this paper, we use delicate PDE methods to obtain a strong solution. Different from the viscosity solution, based on our solution, we succeed in deriving an optimal feedback payout strategy, which is expressed in terms of two free boundaries and the running maximum surplus process. Furthermore, we have obtained many properties of the value function and the free boundaries such as the boundedness, continuity etc. Numerical examples are presented as well to verify our theoretical results and give some new but not proved financial insights.


title: Analyze Drivers' Intervention Behavior During Autonomous Driving -- A VR-incorporated Approach

abstract: Given the rapid advance in ITS technologies, future mobility is pointing to vehicular autonomy. However, there is still a long way before full automation, and human intervention is required. This work sheds light on understanding human drivers' intervention behavior involved in the operation of autonomous vehicles (AVs) and utilizes this knowledge to improve the perception of critical driving scenarios. Experiment environments were implemented where the virtual reality (VR) and traffic micro-simulation are integrated, and tests were carried out under typical and diverse traffic scenes. Performance indicators such as the probability of intervention, accident rates are defined and used to quantify and compare the risk levels. By offering novel insights into drivers' intervention behavior, this work will help improve the performances of the automated control under similar scenarios. Furthermore, such an integrated and immersive tool for autonomous driving studies will be valuable for research on human-to-automation trust. To the best knowledge of the authors, this work is among the pioneer works making efforts into such types of tools.


title: Groebner--Shirshov bases method for vertex algebras

abstract: In this note we show how to apply the Gr\"obner--Shirshov bases (GSB) method for modules over an associative algebra to the study of vertex algebras defined by generators and relations. We compute GSBs for a series of vertex algebras and study the problem of embedding of a left-symmetric algebra into a vertex one preserving the normally ordered product.


title: Multimodality-guided Image Style Transfer using Cross-modal GAN Inversion

abstract: Image Style Transfer (IST) is an interdisciplinary topic of computer vision and art that continuously attracts researchers' interests. Different from traditional Image-guided Image Style Transfer (IIST) methods that require a style reference image as input to define the desired style, recent works start to tackle the problem in a text-guided manner, i.e., Text-guided Image Style Transfer (TIST). Compared to IIST, such approaches provide more flexibility with text-specified styles, which are useful in scenarios where the style is hard to define with reference images. Unfortunately, many TIST approaches produce undesirable artifacts in the transferred images. To address this issue, we present a novel method to achieve much improved style transfer based on text guidance. Meanwhile, to offer more flexibility than IIST and TIST, our method allows style inputs from multiple sources and modalities, enabling MultiModality-guided Image Style Transfer (MMIST). Specifically, we realize MMIST with a novel cross-modal GAN inversion method, which generates style representations consistent with specified styles. Such style representations facilitate style transfer and in principle generalize any IIST methods to MMIST. Large-scale experiments and user studies demonstrate that our method achieves state-of-the-art performance on TIST task. Furthermore, comprehensive qualitative results confirm the effectiveness of our method on MMIST task and cross-modal style interpolation.


title: STADEE: STAtistics-based DEEp Detection of Machine Generated Text

abstract: We present STADEE, a \textbf{STA}tistics-based \textbf{DEE}p detection method to identify machine-generated text, addressing the limitations of current methods that rely heavily on fine-tuning pre-trained language models (PLMs). STADEE integrates key statistical text features with a deep classifier, focusing on aspects like token probability and cumulative probability, crucial for handling nucleus sampling. Tested across diverse datasets and scenarios (in-domain, out-of-domain, and in-the-wild), STADEE demonstrates superior performance, achieving an 87.05% F1 score in-domain and outperforming both traditional statistical methods and fine-tuned PLMs, especially in out-of-domain and in-the-wild settings, highlighting its effectiveness and generalizability.


title: Seamless prediction of high-impact weather events: a comparison of actionable forecasts

abstract: A new index for high-impact weather forecasting is introduced and assessed in comparison with the well-established extreme forecast index (EFI). Two other ensemble summary statistics are also included in this comparison study: the shift-of-tail and a standardised ensemble mean anomaly. All these forecasts are based on the same ingredients: the ensemble forecast run at the European Centre for Medium-Range Weather Forecasts and the corresponding model climatology derived from a set of reforecasts. The new index emerges from recent developments in forecast verification of extreme events: it is derived as a consistent forecast with the diagonal score, a weighted version of the continuous ranked probability score targetting high-impact events. In this study, we emphasise the importance of forecast discretisation for communication purposes and decision-making. A forecast is actionable in the situation where a user can decide to take action when a threshold is exceeded by the forecast. Forecast verification is performed to assess both the potential skill of the different indices as well as their specific skill as actionable forecasts. Among the investigated actionable forecasts, the new proposed index demonstrates the strongest discrimination power, in particular at longer lead times, paving the way for seamless predictions of high-impact weather across time ranges.


title: EDALearn: A Comprehensive RTL-to-Signoff EDA Benchmark for Democratized and Reproducible ML for EDA Research

abstract: The application of Machine Learning (ML) in Electronic Design Automation (EDA) for Very Large-Scale Integration (VLSI) design has garnered significant research attention. Despite the requirement for extensive datasets to build effective ML models, most studies are limited to smaller, internally generated datasets due to the lack of comprehensive public resources. In response, we introduce EDALearn, the first holistic, open-source benchmark suite specifically for ML tasks in EDA. This benchmark suite presents an end-to-end flow from synthesis to physical implementation, enriching data collection across various stages. It fosters reproducibility and promotes research into ML transferability across different technology nodes. Accommodating a wide range of VLSI design instances and sizes, our benchmark aptly represents the complexity of contemporary VLSI designs. Additionally, we provide an in-depth data analysis, enabling users to fully comprehend the attributes and distribution of our data, which is essential for creating efficient ML models. Our contributions aim to encourage further advances in the ML-EDA domain.


title: On a previously unpublished work with Ralph Kenna

abstract: This is part of an unpublished work in collaboration with Ralph Kenna. It was probably not mature enough at the time it was submitted more than ten years ago and it was rejected by the editors, but some of the ideas have later been published partially in subsequent works. I believe that this ``draft'' reveals a lot about Ralph's enthusiasm and audacity and deserves to be published now, maybe as a part of his legacy.


title: Controllability of a second-order impulsive neutral differential equation via resolvent operator technique

abstract: This paper uses the resolvent operator technique to investigate second-order non-autonomous neutral integrodifferential equations with impulsive conditions in a Banach space. We study the existence of a mild solution and the system's approximate controllability. The semigroup and resolvent operator theory, graph norm, and Krasnoselskii's fixed point theorem are used to demonstrate the results. Finally, we present our findings with an example.


title: Multi-task Image Restoration Guided By Robust DINO Features

abstract: Multi-task image restoration has gained significant interest due to its inherent versatility and efficiency compared to its single-task counterpart. Despite its potential, performance degradation is observed with an increase in the number of tasks, primarily attributed to the distinct nature of each restoration task. Addressing this challenge, we introduce \mbox{\textbf{DINO-IR}}, a novel multi-task image restoration approach leveraging robust features extracted from DINOv2. Our empirical analysis shows that while shallow features of DINOv2 capture rich low-level image characteristics, the deep features ensure a robust semantic representation insensitive to degradations while preserving high-frequency contour details. Building on these features, we devise specialized components, including multi-layer semantic fusion module, DINO-Restore adaption and fusion module, and DINO perception contrastive loss, to integrate DINOv2 features into the restoration paradigm. Equipped with the aforementioned components, our DINO-IR performs favorably against existing multi-task image restoration approaches in various tasks by a large margin, indicating the superiority and necessity of reinforcing the robust features for multi-task image restoration.


title: Jellyfish: A Large Language Model for Data Preprocessing

abstract: This paper explores the utilization of LLMs for data preprocessing (DP), a crucial step in the data mining pipeline that transforms raw data into a clean format conducive to easy processing. Whereas the use of LLMs has sparked interest in devising universal solutions to DP, recent initiatives in this domain typically rely on GPT APIs, raising inevitable data breach concerns. Unlike these approaches, we consider instruction-tuning local LLMs (7 -- 13B models) as universal DP task solvers that operate on a local, single, and low-priced GPU, ensuring data security and enabling further customization. We select a collection of datasets across four representative DP tasks and construct instruction tuning data using data configuration, knowledge injection, and reasoning data distillation techniques tailored to DP. By tuning Mistral-7B, Llama 3-8B, and OpenOrca-Platypus2-13B, our models, namely, Jellyfish-7B/8B/13B, deliver competitiveness compared to GPT-3.5/4 models and strong generalizability to unseen tasks while barely compromising the base models' abilities in NLP tasks. Meanwhile, Jellyfish offers enhanced reasoning capabilities compared to GPT-3.5. Our models are available at: https://huggingface.co/NECOUDBFM/Jellyfish . Our instruction dataset is available at: https://huggingface.co/datasets/NECOUDBFM/Jellyfish-Instruct .


title: Adversarial Medical Image with Hierarchical Feature Hiding

abstract: Deep learning based methods for medical images can be easily compromised by adversarial examples (AEs), posing a great security flaw in clinical decision-making. It has been discovered that conventional adversarial attacks like PGD which optimize the classification logits, are easy to distinguish in the feature space, resulting in accurate reactive defenses. To better understand this phenomenon and reassess the reliability of the reactive defenses for medical AEs, we thoroughly investigate the characteristic of conventional medical AEs. Specifically, we first theoretically prove that conventional adversarial attacks change the outputs by continuously optimizing vulnerable features in a fixed direction, thereby leading to outlier representations in the feature space. Then, a stress test is conducted to reveal the vulnerability of medical images, by comparing with natural images. Interestingly, this vulnerability is a double-edged sword, which can be exploited to hide AEs. We then propose a simple-yet-effective hierarchical feature constraint (HFC), a novel add-on to conventional white-box attacks, which assists to hide the adversarial feature in the target feature distribution. The proposed method is evaluated on three medical datasets, both 2D and 3D, with different modalities. The experimental results demonstrate the superiority of HFC, \emph{i.e.,} it bypasses an array of state-of-the-art adversarial medical AE detectors more efficiently than competing adaptive attacks, which reveals the deficiencies of medical reactive defense and allows to develop more robust defenses in future.


title: With Great Humor Comes Great Developer Engagement

abstract: The worldwide collaborative effort for the creation of software is technically and socially demanding. The more engaged developers are, the more value they impart to the software they create. Engaged developers, such as Margaret Hamilton programming Apollo 11, can succeed in tackling the most difficult engineering tasks. In this paper, we dive deep into an original vector of engagement - humor - and study how it fuels developer engagement. First, we collect qualitative and quantitative data about the humorous elements present within three significant, real-world software projects: faker, which helps developers introduce humor within their tests; lolcommits, which captures a photograph after each contribution made by a developer; and volkswagen, an exercise in satire, which accidentally led to the invention of an impactful software tool. Second, through a developer survey, we receive unique insights from 125 developers, who share their real-life experiences with humor in software. Our analysis of the three case studies highlights the prevalence of humor in software, and unveils the worldwide community of developers who are enthusiastic about both software and humor. We also learn about the caveats of humor in software through the valuable insights shared by our survey respondents. We report clear evidence that, when practiced responsibly, humor increases developer engagement and supports them in addressing hard engineering and cognitive tasks. The most actionable highlight of our work is that software tests and documentation are the best locations in code to practice humor.


title: Malicious Lateral Movement in 5G Core With Network Slicing And Its Detection

abstract: 5G networks are susceptible to cyber attacks due to reasons such as implementation issues and vulnerabilities in 3GPP standard specifications. In this work, we propose lateral movement strategies in a 5G Core (5GC) with network slicing enabled, as part of a larger attack campaign by well-resourced adversaries such as APT groups. Further, we present 5GLatte, a system to detect such malicious lateral movement. 5GLatte operates on a host-container access graph built using host/NF container logs collected from the 5GC. Paths inferred from the access graph are scored based on selected filtering criteria and subsequently presented as input to a threshold-based anomaly detection algorithm to reveal malicious lateral movement paths. We evaluate 5GLatte on a dataset containing attack campaigns (based on MITRE ATT&CK and FiGHT frameworks) launched in a 5G test environment which shows that compared to other lateral movement detectors based on state-of-the-art, it can achieve higher true positive rates with similar false positive rates.


title: ResEnsemble-DDPM: Residual Denoising Diffusion Probabilistic Models for Ensemble Learning

abstract: Nowadays, denoising diffusion probabilistic models have been adapted for many image segmentation tasks. However, existing end-to-end models have already demonstrated remarkable capabilities. Rather than using denoising diffusion probabilistic models alone, integrating the abilities of both denoising diffusion probabilistic models and existing end-to-end models can better improve the performance of image segmentation. Based on this, we implicitly introduce residual term into the diffusion process and propose ResEnsemble-DDPM, which seamlessly integrates the diffusion model and the end-to-end model through ensemble learning. The output distributions of these two models are strictly symmetric with respect to the ground truth distribution, allowing us to integrate the two models by reducing the residual term. Experimental results demonstrate that our ResEnsemble-DDPM can further improve the capabilities of existing models. Furthermore, its ensemble learning strategy can be generalized to other downstream tasks in image generation and get strong competitiveness.


title: Copositivity of a class of fourth order symmetric tensors

abstract: In this paper, we mainly dicuss the analytic conditions of copositivity of a class of 4th order 3-dimensional symmetric tensors. For a 4th order 3-dimensional symmetric tensor with its entries $1$ or $-1$, an analytic necessary and sufficient condition is given for its strict copositivity with the help of the properties of strictly semi-positive tensors. And by means of usual maxi-min theory, a necessary and sufficient condition is established for copositivity of such a tensor also. Applying these conclusions to a general 4th order 3-dimensional symmetric tensor, the analytic conditions are successfully obtained for verifying the (strict) copositivity, and these conditions can be very easily parsed and validated.


title: Orbital angular momentum-enhanced phase estimation using non-Gaussian state with photon loss

abstract: This study investigates the use of orbital angular momentum (OAM) to enhance phase estimation in Mach-Zehnder interferometers (MZIs) by employing non-Gaussian states as input resources in the presence of noise. Our research demonstrates that non-Gaussian states, particularly the photonsubtraction-then-addition (PSA) state, exhibit the best sensitivity in the presence of symmetric noise. Additionally, higher-order of Bose operator of non-Gaussian states provide better sensitivity for symmetric noise. OAM can mitigate the deterioration of noise, making it possible to estimate small phase shifts theta close to 0. OAM enhances the resolution and sensitivity of all input states and mitigating the deterioration caused by photon loss. Additionally, OAM enhances the resolution and sensitivity of all input states, enabling the sensitivity to approach the 1/N limit even under significant photon loss (e.g.,50% symmetric photon loss). These results hold promise for enhancing the sensitivity and robustness of quantum metrology, particularly in the presence of significant photon loss.


title: Optimal rate of convergence to nondegenerate asymptotic profiles for fast diffusion in domains

abstract: This paper is concerned with the Cauchy-Dirichlet problem for fast diffusion equations posed in bounded domains, where every energy solution vanishes in finite time and a suitably rescaled solution converges to an asymptotic profile. Bonforte and Figalli (CPAM, 2021) first proved an exponential convergence to nondegenerate positive asymptotic profiles for nonnegative rescaled solutions in a weighted $L^2$ norm for smooth bounded domains by developing a nonlinear entropy method. However, the optimality of the rate remains open to question. In the present paper, their result is fully extended to possibly sign-changing asymptotic profiles as well as general bounded domains by improving an energy method along with a quantitative gradient inequality developed by the first author (ARMA, 2023). Moreover, a (quantitative) exponential stability result for least-energy asymptotic profiles follows as a corollary, and it is further employed to prove the optimality of the exponential rate.


title: Poles, Residues and Siegel-Weil Identities of Degenerate Eisenstein Series on Split Exceptional Groups of Type $E_n$

abstract: This manuscript has two goals: 1. To write an explicit description of the degenerate residual spectrum of the split, simple, simply-connected, exceptional groups of type $E_n$ (for $n=6,7,8$). 2. To set a practical guide for similar calculations and, in particular, to describe various methods of ``computational representation theory'' relevant to the study of residues of automorphic Eisenstein series. In Part I we supply background information and notations from the theory of automorphic representations as well as concrete information on the exceptional groups of type $E_n$ and their representation theory over non-Archimedean local fields. In Part II we make a systematic study of the residual spectrum of these groups where each chapter is devoted to a certain aspect of theory, it begins with methodical section and continues with sections devoted to the results for each of these groups. We describe completely the residual (square-integrable and non-square integrable) spectrum of the groups of type $E_6$ and $E_7$ and an almost complete description in the case of the group of type $E_8$. We also study and list Siegel-Weil like identities between residual representations of these groups and list the Arthur parameters for their square-integrable residual representations.


title: Optimizing Bus Travel: A Novel Approach to Feature Mining with P-KMEANS and P-LDA Algorithms

abstract: Customizing services for bus travel can bolster its attractiveness, optimize usage, alleviate traffic congestion, and diminish carbon emissions. This potential is realized by harnessing recent advancements in positioning communication facilities, the Internet of Things, and artificial intelligence for feature mining in public transportation. However, the inherent complexities of disorganized and unstructured public transportation data introduce substantial challenges to travel feature extraction. This study presents a bus travel feature extraction method rooted in Point of Interest (POI) data, employing enhanced P-KMENAS and P-LDA algorithms to overcome these limitations. While the KMEANS algorithm adeptly segments passenger travel paths into distinct clusters, its outcomes can be influenced by the initial K value. On the other hand, Latent Dirichlet Allocation (LDA) excels at feature identification and probabilistic interpretations yet encounters difficulties with feature intermingling and nuanced sub-feature interactions. Incorporating the POI dimension enhances our understanding of travel behavior, aligning it more closely with passenger attributes and facilitating easier data analysis. By incorporating POI data, our refined P-KMENAS and P-LDA algorithms grant a holistic insight into travel behaviors and attributes, effectively mitigating the limitations above. Consequently, this POI-centric algorithm effectively amalgamates diverse POI attributes, delineates varied travel contexts, and imparts probabilistic metrics to feature properties. Our method successfully mines the diverse aspects of bus travel, such as age, occupation, gender, sports, cost, safety, and personality traits. It effectively calculates relationships between individual travel behaviors and assigns explanatory and evaluative probabilities to POI labels, thereby enhancing bus travel optimization.


title: Tab-Attention: Self-Attention-based Stacked Generalization for Imbalanced Credit Default Prediction

abstract: Accurately credit default prediction faces challenges due to imbalanced data and low correlation between features and labels. Existing default prediction studies on the basis of gradient boosting decision trees (GBDT), deep learning techniques, and feature selection strategies can have varying degrees of success depending on the specific task. Motivated by this, we propose Tab-Attention, a novel self-attention-based stacked generalization method for credit default prediction. This approach ensembles the potential proprietary knowledge contributions from multi-view feature spaces, to cope with low feature correlation and imbalance. We organize multi-view feature spaces according to the latent linear or nonlinear strengths between features and labels. Meanwhile, the f1 score assists the model in imbalance training to find the optimal state for identifying minority default samples. Our Tab-Attention achieves superior Recall_1 and f1_1 of default intention recognition than existing GBDT-based models and advanced deep learning by about 32.92% and 16.05% on average, respectively, while maintaining outstanding overall performance and prediction performance for non-default samples. The proposed method could ensemble essential knowledge through the self-attention mechanism, which is of great significance for a more robust future prediction system.


title: Fast and accurate sparse-view CBCT reconstruction using meta-learned neural attenuation field and hash-encoding regularization

abstract: Cone beam computed tomography (CBCT) is an emerging medical imaging technique to visualize the internal anatomical structures of patients. During a CBCT scan, several projection images of different angles or views are collectively utilized to reconstruct a tomographic image. However, reducing the number of projections in a CBCT scan while preserving the quality of a reconstructed image is challenging due to the nature of an ill-posed inverse problem. Recently, a neural attenuation field (NAF) method was proposed by adopting a neural radiance field algorithm as a new way for CBCT reconstruction, demonstrating fast and promising results using only 50 views. However, decreasing the number of projections is still preferable to reduce potential radiation exposure, and a faster reconstruction time is required considering a typical scan time. In this work, we propose a fast and accurate sparse-view CBCT reconstruction (FACT) method to provide better reconstruction quality and faster optimization speed in the minimal number of view acquisitions ($<$ 50 views). In the FACT method, we meta-trained a neural network and a hash-encoder using a few scans (= 15), and a new regularization technique is utilized to reconstruct the details of an anatomical structure. In conclusion, we have shown that the FACT method produced better, and faster reconstruction results over the other conventional algorithms based on CBCT scans of different body parts (chest, head, and abdomen) and CT vendors (Siemens, Phillips, and GE).


title: Dynamic mode decomposition for Koopman spectral analysis of elementary cellular automata

abstract: We apply Dynamic Mode Decomposition (DMD) to Elementary Cellular Automata (ECA). Three types of DMD methods are considered and the reproducibility of the system dynamics and Koopman eigenvalues from observed time series are investigated. While standard DMD fails to reproduce the system dynamics and Koopman eigenvalues associated with a given periodic orbit in some cases, Hankel DMD with delay-embedded time series improves reproducibility. However, Hankel DMD can still fail to reproduce all the Koopman eigenvalues in specific cases. We propose an Extended DMD method for ECA that uses nonlinearly transformed time series with discretized Walsh functions and show that it can completely reproduce the dynamics and Koopman eigenvalues. Linear-algebraic backgrounds for the reproducibility of the system dynamics and Koopman eigenvalues are also discussed.


title: Estimating Coronal Mass Ejection Mass and Kinetic Energy by Fusion of Multiple Deep-learning Models

abstract: Coronal mass ejections (CMEs) are massive solar eruptions, which have a significant impact on Earth. In this paper, we propose a new method, called DeepCME, to estimate two properties of CMEs, namely, CME mass and kinetic energy. Being able to estimate these properties helps better understand CME dynamics. Our study is based on the CME catalog maintained at the Coordinated Data Analysis Workshops (CDAW) Data Center, which contains all CMEs manually identified since 1996 using the Large Angle and Spectrometric Coronagraph (LASCO) on board the Solar and Heliospheric Observatory (SOHO). We use LASCO C2 data in the period between January 1996 and December 2020 to train, validate and test DeepCME through 10-fold cross validation. The DeepCME method is a fusion of three deep learning models, including ResNet, InceptionNet, and InceptionResNet. Our fusion model extracts features from LASCO C2 images, effectively combining the learning capabilities of the three component models to jointly estimate the mass and kinetic energy of CMEs. Experimental results show that the fusion model yields a mean relative error (MRE) of 0.013 (0.009, respectively) compared to the MRE of 0.019 (0.017, respectively) of the best component model InceptionResNet (InceptionNet, respectively) in estimating the CME mass (kinetic energy, respectively). To our knowledge, this is the first time that deep learning has been used for CME mass and kinetic energy estimations.


title: Risk-Controlling Model Selection via Guided Bayesian Optimization

abstract: Adjustable hyperparameters of machine learning models typically impact various key trade-offs such as accuracy, fairness, robustness, or inference cost. Our goal in this paper is to find a configuration that adheres to user-specified limits on certain risks while being useful with respect to other conflicting metrics. We solve this by combining Bayesian Optimization (BO) with rigorous risk-controlling procedures, where our core idea is to steer BO towards an efficient testing strategy. Our BO method identifies a set of Pareto optimal configurations residing in a designated region of interest. The resulting candidates are statistically verified and the best-performing configuration is selected with guaranteed risk levels. We demonstrate the effectiveness of our approach on a range of tasks with multiple desiderata, including low error rates, equitable predictions, handling spurious correlations, managing rate and distortion in generative models, and reducing computational costs.


title: Chiral perturbative evaluation for the (second) lightest mass $M_{1,2}$ of right-handed neutrino $\nu_{R 1,2}$ in unified theories with sequential dominance

abstract: In this paper, we evaluate the (second) lightest mass $M_{1,2}$ of right-handed neutrino $\nu_{R1,2}$ in grand unified theories with the type-I seesaw mechanism that predicts an almost massless neutrino $m_{1 \, \rm or \, 3} \sim 0$. By chiral perturbative treatment, the masses $M_{1,2}$ are expressed as $M_{1} = m_{D1}^{2}/m_{11} , \, M_{2} = m_{D2}^{2} m_{11} / (m_{11} m_{22} - m_{12}^{2})$ with the mass matrix of left-handed neutrinos $m$ in the diagonal basis of the Dirac mass matrix $m_{D}$. Assuming $m_{Di}$ and the unitary matrix $V$ in the singular value decomposition $(m_{D})_{ij} = V_{ik} m_{D k} U^{\dagger}_{kj}$ are close to observed fermion masses and the CKM matrix, $M_{1,2}$ and their allowed regions are expressed by parameters in the low energy and unknown phases. As a result, for $m_{D1} \simeq 0.5$ MeV and $m_{D2} \simeq 100$ MeV, we obtain $M_{1}^{\rm NH} \simeq 3 \times 10^{4 - 6}$ GeV and $M_{2}^{\rm NH} \simeq 3 \times 10^{6-8}$ GeV in the NH, $M_{1}^{\rm IH} \simeq 5 \times 10^{3 - 4}$ GeV and $M_{2}^{\rm IH} \simeq 4 \times 10^{8-9}$ GeV in the IH. These upper and lower bounds are proportional to $m_{Di}^{2}$ or $m_{D1} m_{D2}$.


title: Real-Space Visualization of Frequency-Dependent Anisotropy of Atomic Vibrations

abstract: The underlying dielectric properties of materials, intertwined with intriguing phenomena such as topological polariton modes and anisotropic thermal conductivities, stem from the anisotropy in atomic vibrations. Conventionally, X-ray diffraction techniques have been employed to estimate thermal ellipsoids of distinct elements, albeit lacking the desired spatial and energy resolutions. Here we introduce a novel approach utilizing the dark-field monochromated electron energy-loss spectroscopy for momentum-selective vibrational spectroscopy, enabling the cartographic delineation of variations of phonon polarization vectors. By applying this technique to centrosymmetric cubic-phase strontium titanate, we successfully discern two types of oxygen atoms exhibiting contrasting vibrational anisotropies below and above 60 meV due to their frequency-linked thermal ellipsoids. This method establishes a new pathway to visualize phonon eigenvectors at specific crystalline sites for diverse elements, thus delving into uncharted realms of dielectric, optical, and thermal property investigations with unprecedented spatial resolutions.


title: Quantitative Destruction of Lagrangian Torus

abstract: Let $P_N$ be a trigonometric polynomial of degree $N$ and satisfy $\|P_N\|_{C^r}\leq \epsilon$. If $P_N$ destroys the Lagrangian torus with the rotation vector $\omega$ of an integrable Hamiltonian system, then {what are the relation among $\epsilon$, $N$, $r$ and the arithmetic property of $\omega$}? By addressing this, we provide quantitatively higher dimensional generalizations of the remarkable results on destruction of invariant circles for the area-preserving twist map by Herman [22] and Mather [30] in the 1980's. As an application, we give a partial answer to an open problem by Mather [30, p.212] in 1988.


title: BEVNeXt: Reviving Dense BEV Frameworks for 3D Object Detection

abstract: Recently, the rise of query-based Transformer decoders is reshaping camera-based 3D object detection. These query-based decoders are surpassing the traditional dense BEV (Bird's Eye View)-based methods. However, we argue that dense BEV frameworks remain important due to their outstanding abilities in depth estimation and object localization, depicting 3D scenes accurately and comprehensively. This paper aims to address the drawbacks of the existing dense BEV-based 3D object detectors by introducing our proposed enhanced components, including a CRF-modulated depth estimation module enforcing object-level consistencies, a long-term temporal aggregation module with extended receptive fields, and a two-stage object decoder combining perspective techniques with CRF-modulated depth embedding. These enhancements lead to a "modernized" dense BEV framework dubbed BEVNeXt. On the nuScenes benchmark, BEVNeXt outperforms both BEV-based and query-based frameworks under various settings, achieving a state-of-the-art result of 64.2 NDS on the nuScenes test set. Code will be available at \url{https://github.com/woxihuanjiangguo/BEVNeXt}.


title: Hulk: A Universal Knowledge Translator for Human-Centric Tasks

abstract: Human-centric perception tasks, e.g., pedestrian detection, skeleton-based action recognition, and pose estimation, have wide industrial applications, such as metaverse and sports analysis. There is a recent surge to develop human-centric foundation models that can benefit a broad range of human-centric perception tasks. While many human-centric foundation models have achieved success, they did not explore 3D and vision-language tasks for human-centric and required task-specific finetuning. These limitations restrict their application to more downstream tasks and situations. To tackle these problems, we present Hulk, the first multimodal human-centric generalist model, capable of addressing 2D vision, 3D vision, skeleton-based, and vision-language tasks without task-specific finetuning. The key to achieving this is condensing various task-specific heads into two general heads, one for discrete representations, e.g., languages, and the other for continuous representations, e.g., location coordinates. The outputs of two heads can be further stacked into four distinct input and output modalities. This uniform representation enables Hulk to treat diverse human-centric tasks as modality translation, integrating knowledge across a wide range of tasks. Comprehensive evaluations of Hulk on 12 benchmarks covering 8 human-centric tasks demonstrate the superiority of our proposed method, achieving state-of-the-art performance in 11 benchmarks. The code is available on https://github.com/OpenGVLab/Hulk.


title: Flows of piecewise analytic vector fields in convex polytope decompositions

abstract: We prove that for a convex polytope decomposition of a domain in $\mathbb R^n$, an integral curve of a piecewise analytic vector field is chopped by the decomposition into finitely many pieces. As a consequence, we prove the finiteness of the number of the edge flips in a discrete Yamabe flow.


title: Rethinking Urban Mobility Prediction: A Super-Multivariate Time Series Forecasting Approach

abstract: Long-term urban mobility predictions play a crucial role in the effective management of urban facilities and services. Conventionally, urban mobility data has been structured as spatiotemporal videos, treating longitude and latitude grids as fundamental pixels. Consequently, video prediction methods, relying on Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs), have been instrumental in this domain. In our research, we introduce a fresh perspective on urban mobility prediction. Instead of oversimplifying urban mobility data as traditional video data, we regard it as a complex multivariate time series. This perspective involves treating the time-varying values of each grid in each channel as individual time series, necessitating a thorough examination of temporal dynamics, cross-variable correlations, and frequency-domain insights for precise and reliable predictions. To address this challenge, we present the Super-Multivariate Urban Mobility Transformer (SUMformer), which utilizes a specially designed attention mechanism to calculate temporal and cross-variable correlations and reduce computational costs stemming from a large number of time series. SUMformer also employs low-frequency filters to extract essential information for long-term predictions. Furthermore, SUMformer is structured with a temporal patch merge mechanism, forming a hierarchical framework that enables the capture of multi-scale correlations. Consequently, it excels in urban mobility pattern modeling and long-term prediction, outperforming current state-of-the-art methods across three real-world datasets.


title: Data Management For Large Language Models: A Survey

abstract: Data plays a fundamental role in the training of Large Language Models (LLMs). Effective data management, particularly in the formulation of a well-suited training dataset, holds significance for enhancing model performance and improving training efficiency during pretraining and supervised fine-tuning phases. Despite the considerable importance of data management, the current research community still falls short in providing a systematic analysis of the rationale behind management strategy selection, its consequential effects, methodologies for evaluating curated datasets, and the ongoing pursuit of improved strategies. Consequently, the exploration of data management has attracted more and more attention among the research community. This survey provides a comprehensive overview of current research in data management within both the pretraining and supervised fine-tuning stages of LLMs, covering various noteworthy aspects of data management strategy design: data quantity, data quality, domain/task composition, etc. Looking toward the future, we extrapolate existing challenges and outline promising directions for development in this field. Therefore, this survey serves as a guiding resource for practitioners aspiring to construct powerful LLMs through effective data management practices. The collection of the latest papers is available at https://github.com/ZigeW/data_management_LLM.


title: Mitigating Fine-Grained Hallucination by Fine-Tuning Large Vision-Language Models with Caption Rewrites

abstract: Large language models (LLMs) have shown remarkable performance in natural language processing (NLP) tasks. To comprehend and execute diverse human instructions over image data, instruction-tuned large vision-language models (LVLMs) have been introduced. However, LVLMs may suffer from different types of object hallucinations. Nevertheless, LVLMs are evaluated for coarse-grained object hallucinations only (i.e., generated objects non-existent in the input image). The fine-grained object attributes and behaviors non-existent in the image may still be generated but not measured by the current evaluation methods. In this paper, we thus focus on reducing fine-grained hallucinations of LVLMs. We propose \textit{ReCaption}, a framework that consists of two components: rewriting captions using ChatGPT and fine-tuning the instruction-tuned LVLMs on the rewritten captions. We also propose a fine-grained probing-based evaluation method named \textit{Fine-Grained Object Hallucination Evaluation} (\textit{FGHE}). Our experiment results demonstrate that ReCaption effectively reduces fine-grained object hallucination for different LVLM options and improves their text generation quality. The code can be found at https://github.com/Anonymousanoy/FOHE.


title: Tracking complex singularities of fluids on log-lattices

abstract: In 1981, Frisch and Morf [1] postulated the existence of complex singularities in solutions of Navier-Stokes equations. Present progress on this conjecture is hindered by the computational burden involved in simulations of the Euler equations or the Navier-Stokes equations at high Reynolds numbers. We investigate this conjecture in the case of fluid dynamics on log-lattices, where the computational burden is logarithmic concerning ordinary fluid simulations. We analyze properties of potential complex singularities in both 1D and 3D models for lattices of different spacings. Dominant complex singularities are tracked using the singularity strip method to obtain new scalings regarding the approach to the real axis and the influence of normal, hypo and hyper dissipation.


title: Test of vector portal with dark fermions in the charge-exchange reactions in the NA64 experiment at CERN SPS

abstract: We consider an experiment to search for dark sector particles in dark photon kinetic mixing model by analyze invisible and semi-invisible decays of neutral mesons $M^0 = \pi^0$, $\eta$, $\eta'$, $\omega$, $f_2(1270)$, produced in the NA64 experiment at the CERN SPS. The approach proposed in Ref.~\cite{Gninenko:2014sxa} is to use the charge-exchange reactions $\pi^- + (A, Z) \to M^0 + (A,Z-1); M^0 \to$ invisible or semi-invisible of high-energy pions (or kaons) at a nuclei target as a source of $M^0$s, which subsequently decay invisibly into dark sector. This reaction chain would lead to a striking signature of the signal event - the complete disappearance of the beam energy in the setup. Using data obtained from the study of charge-exchange reactions at IHEP (Protvino) and Fermilab (Batavia) we show that the integral cross sections $\sigma$ for production of the neutral mesons $M^0$ are slightly deviate from phenomenological formula $\sigma \sim Z^{2/3}$, where $Z$ is the nuclei charge. In particular, we present the formulas for the differential and integral sections that explicitly depend on the Mandelstam and $Z$ variables. Derived formulas are used to predict the cross sections as a function of beam energy for several target nuclei, and to estimate the projection sensitivity for the proposed search for the $M^0\to$ semi-invisible and $M^0\to$ invisible decays through the vector portal to dark sector. Sensitivity to different semi-invisible decay modes of neutral pseudoscalar mesons is studied.