title: Basmajian's identity over non-Archimedean local fields

abstract: Let $\Sigma$ be a connected compact oriented surface with boundary and negative Euler characteristic. Let $k$ be a non-Archimedean local field. In this paper, we prove Basmajian's identity for projective Anosov representations from $\pi_1\Sigma$ to ${\rm PSL}(2,k)$ using Berkovich hyperbolic geometry.


title: Are Deep Neural Networks SMARTer than Second Graders?

abstract: Recent times have witnessed an increasing number of applications of deep neural networks towards solving tasks that require superior cognitive abilities, e.g., playing Go, generating art, ChatGPT, etc. Such a dramatic progress raises the question: how generalizable are neural networks in solving problems that demand broad skills? To answer this question, we propose SMART: a Simple Multimodal Algorithmic Reasoning Task and the associated SMART-101 dataset, for evaluating the abstraction, deduction, and generalization abilities of neural networks in solving visuo-linguistic puzzles designed specifically for children in the 6--8 age group. Our dataset consists of 101 unique puzzles; each puzzle comprises a picture and a question, and their solution needs a mix of several elementary skills, including arithmetic, algebra, and spatial reasoning, among others. To scale our dataset towards training deep neural networks, we programmatically generate entirely new instances for each puzzle, while retaining their solution algorithm. To benchmark performances on SMART-101, we propose a vision and language meta-learning model using varied state-of-the-art backbones. Our experiments reveal that while powerful deep models offer reasonable performances on puzzles in a supervised setting, they are not better than random accuracy when analyzed for generalization. We also evaluate the recent ChatGPT and other large language models on a subset of SMART-101 and find that while these models show convincing reasoning abilities, the answers are often incorrect.


title: Towards Robustness of Text-to-SQL Models Against Natural and Realistic Adversarial Table Perturbation

abstract: The robustness of Text-to-SQL parsers against adversarial perturbations plays a crucial role in delivering highly reliable applications. Previous studies along this line primarily focused on perturbations in the natural language question side, neglecting the variability of tables. Motivated by this, we propose the Adversarial Table Perturbation (ATP) as a new attacking paradigm to measure the robustness of Text-to-SQL models. Following this proposition, we curate ADVETA, the first robustness evaluation benchmark featuring natural and realistic ATPs. All tested state-of-the-art models experience dramatic performance drops on ADVETA, revealing models' vulnerability in real-world practices. To defend against ATP, we build a systematic adversarial training example generation framework tailored for better contextualization of tabular data. Experiments show that our approach not only brings the best robustness improvement against table-side perturbations but also substantially empowers models against NL-side perturbations. We release our benchmark and code at: https://github.com/microsoft/ContextualSP.


title: Quantum annealing showing the exponentially small success probability despite a constant energy gap

abstract: Quantum annealing (QA) is one of the methods to solve combinatorial optimization problems. We can estimate a computational time of QA by using the so-called adiabatic condition derived from the adiabatic theorem. The adiabatic condition consists of two parts: an energy gap and a transition matrix. It is believed that the computational time mainly depends on the energy gap during QA and is inversely proportional to a polynomial of the minimal energy gap. In this paper, we challenge this common wisdom. We propose a general method to construct counterintuitive models with a constant energy gap during QA where QA with a constant annealing time fails despite a constant energy gap. In our formalism, we choose a known model exhibiting an exponentially small energy gap during QA, and we modify the model by adding a specific penalty term to the Hamiltonian. In the modified model, the transition matrix in the adiabatic condition becomes exponentially large with the number of qubits, while the energy gap remains constant. As concrete examples we consider the adiabatic Grover search and the ferromagnetic p-spin model. In these cases, by adding the penalty term, the success probability of QA in the modified models become exponentially small despite a constant energy gap. Our results paves a way for better understanding of the QA performance.


title: A marginalized three-part interrupted time series regression model for proportional data

abstract: Interrupted time series (ITS) is often used to evaluate the effectiveness of a health policy intervention that accounts for the temporal dependence of outcomes. When the outcome of interest is a percentage or percentile, the data can be highly skewed, bounded in $[0, 1]$, and have many zeros or ones. A three-part Beta regression model is commonly used to separate zeros, ones, and positive values explicitly by three submodels. However, incorporating temporal dependence into the three-part Beta regression model is challenging. In this article, we propose a marginalized zero-one-inflated Beta time series model that captures the temporal dependence of outcomes through copula and allows investigators to examine covariate effects on the marginal mean. We investigate its practical performance using simulation studies and apply the model to a real ITS study.


title: Reducing spheres of genus-2 Heegaard splitting of $S^3$

abstract: The Goeritz group of the standard genus-g Heegaard splitting of the three sphere, $G_g$, acts on the space of isotopy classes of reducing spheres for this Heegaard splitting. Scharlemann MR2199366 (2007c:57020) uses this action to prove that $G_2$ is finitely generated. In this article, we give an algorithm to construct any reducing sphere from a standard reducing sphere for a genus-2 Heegaard splitting of the $S^3$. Using this we give an alternate proof of the finite generation of $G_2$ assuming the finite generation of the stabilizer of the standard reducing sphere.


title: A fundamental limit on energy savings in controlled channel flow, and how to beat it

abstract: We derive a limit on energy savings in controlled channel flow. For flow in a channel driven by pressure, shear, or any combination of the two, and controlled via wall transpiration or spanwise wall motion, the uncontrolled laminar state requires the least net energy (accounting for the energetic cost of control). Thus, the optimal control solution is to laminarize the flow. Additionally, we raise the possibility of beating this limit. By simultaneously applying wall transpiration and spanwise wall motion, we show that it may be possible to attain sustained sub-laminar energy expenditure in a controlled flow. We provide a necessary design criterion for net energy savings.


title: Robust simulation design for generalized linear models in conditions of heteroscedasticity or correlation

abstract: A meta-model of the input-output data of a computationally expensive simulation is often employed for prediction, optimization, or sensitivity analysis purposes. Fitting is enabled by a designed experiment, and for computationally expensive simulations, the design efficiency is of importance. Heteroscedasticity in simulation output is common, and it is potentially beneficial to induce dependence through the reuse of pseudo-random number streams to reduce the variance of the meta-model parameter estimators. In this paper, we develop a computational approach to robust design for computer experiments without the need to assume independence or identical distribution of errors. Through explicit inclusion of the variance or correlation structures into the meta-model distribution, either maximum likelihood estimation or generalized estimating equations can be employed to obtain an appropriate Fisher information matrix. Robust designs can then be computationally sought which maximize some relevant summary measure of this matrix, averaged across a prior distribution of any unknown parameters.


title: The carbon cost of a PhD in solar cell materials

abstract: Scientific research can bring about important progress in developing renewable energy technology such as solar cells. However, in addition to positive impact, research also comes at a cost, and one such cost is the CO$_2$ footprint associated with doing research and producing technologies. Here, as an example of such a cost, I estimate the associated greenhouse gas (GHG) emissions associated with my PhD, in which I researched computational and experimental design of thin film materials for photovoltaics. I consider supercomputer power, synchrotron beam time, laboratory synthesis and characterization, travel associated with research, and personal emissions over the course of my PhD. This analysis demonstrates that doing science increases my carbon footprint to much higher than an average American. Because our consumption is so high, scientists have a moral imperative to reduce our own emissions in our laboratories and in the technologies we create.


title: Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters

abstract: Chain-of-Thought (CoT) prompting can dramatically improve the multi-step reasoning abilities of large language models (LLMs). CoT explicitly encourages the LLM to generate intermediate rationales for solving a problem, by providing a series of reasoning steps in the demonstrations. Despite its success, there is still little understanding of what makes CoT prompting effective and which aspects of the demonstrated reasoning steps contribute to its performance. In this paper, we show that CoT reasoning is possible even with invalid demonstrations - prompting with invalid reasoning steps can achieve over 80-90% of the performance obtained using CoT under various metrics, while still generating coherent lines of reasoning during inference. Further experiments show that other aspects of the rationales, such as being relevant to the query and correctly ordering the reasoning steps, are much more important for effective CoT reasoning. Overall, these findings both deepen our understanding of CoT prompting, and open up new questions regarding LLMs' capability to learn to reason in context.


title: Defending Against Disinformation Attacks in Open-Domain Question Answering

abstract: Recent work in open-domain question answering (ODQA) has shown that adversarial poisoning of the search collection can cause large drops in accuracy for production systems. However, little to no work has proposed methods to defend against these attacks. To do so, we rely on the intuition that redundant information often exists in large corpora. To find it, we introduce a method that uses query augmentation to search for a diverse set of passages that could answer the original question but are less likely to have been poisoned. We integrate these new passages into the model through the design of a novel confidence method, comparing the predicted answer to its appearance in the retrieved contexts (what we call Confidence from Answer Redundancy, i.e. CAR). Together these methods allow for a simple but effective way to defend against poisoning attacks that provides gains of nearly 20% exact match across varying levels of data poisoning/knowledge conflicts.


title: (QA)$^2$: Question Answering with Questionable Assumptions

abstract: Naturally occurring information-seeking questions often contain questionable assumptions -- assumptions that are false or unverifiable. Questions containing questionable assumptions are challenging because they require a distinct answer strategy that deviates from typical answers for information-seeking questions. For instance, the question "When did Marie Curie discover Uranium?" cannot be answered as a typical "when" question without addressing the false assumption "Marie Curie discovered Uranium". In this work, we propose (QA)$^2$ (Question Answering with Questionable Assumptions), an open-domain evaluation dataset consisting of naturally occurring search engine queries that may or may not contain questionable assumptions. To be successful on (QA)$^2$, systems must be able to detect questionable assumptions and also be able to produce adequate responses for both typical information-seeking questions and ones with questionable assumptions. Through human rater acceptability on end-to-end QA with (QA)$^2$, we find that current models do struggle with handling questionable assumptions, leaving substantial headroom for progress.


title: Coalition of cubic graphs of order at most $10$

abstract: The coalition in a graph $G$ consists of two disjoint sets of vertices $V_{1}$ and $V_{2}$, neither of which is a dominating set but whose union $V_{1}\cup V_{2}$, is a dominating set. A coalition partition in a graph $G$ is a vertex partition $\pi$ = $\{V_1, V_2,..., V_k \}$ such that every set $V_i \in \pi$ is not a dominating set but forms a coalition with another set $V_j\in \pi$ which is not a dominating set. The coalition number $C(G)$ equals the maximum $k$ of a coalition partition of $G$. In this paper, we compute the coalition number of all cubic graphs of order at most $10$.


title: Calibrating Deep Neural Networks using Explicit Regularisation and Dynamic Data Pruning

abstract: Deep neural networks (DNN) are prone to miscalibrated predictions, often exhibiting a mismatch between the predicted output and the associated confidence scores. Contemporary model calibration techniques mitigate the problem of overconfident predictions by pushing down the confidence of the winning class while increasing the confidence of the remaining classes across all test samples. However, from a deployment perspective, an ideal model is desired to (i) generate well-calibrated predictions for high-confidence samples with predicted probability say >0.95, and (ii) generate a higher proportion of legitimate high-confidence samples. To this end, we propose a novel regularization technique that can be used with classification losses, leading to state-of-the-art calibrated predictions at test time; From a deployment standpoint in safety-critical applications, only high-confidence samples from a well-calibrated model are of interest, as the remaining samples have to undergo manual inspection. Predictive confidence reduction of these potentially ``high-confidence samples'' is a downside of existing calibration approaches. We mitigate this by proposing a dynamic train-time data pruning strategy that prunes low-confidence samples every few epochs, providing an increase in "confident yet calibrated samples". We demonstrate state-of-the-art calibration performance across image classification benchmarks, reducing training time without much compromise in accuracy. We provide insights into why our dynamic pruning strategy that prunes low-confidence training samples leads to an increase in high-confidence samples at test time.


title: Multi-head Uncertainty Inference for Adversarial Attack Detection

abstract: Deep neural networks (DNNs) are sensitive and susceptible to tiny perturbation by adversarial attacks which causes erroneous predictions. Various methods, including adversarial defense and uncertainty inference (UI), have been developed in recent years to overcome the adversarial attacks. In this paper, we propose a multi-head uncertainty inference (MH-UI) framework for detecting adversarial attack examples. We adopt a multi-head architecture with multiple prediction heads (i.e., classifiers) to obtain predictions from different depths in the DNNs and introduce shallow information for the UI. Using independent heads at different depths, the normalized predictions are assumed to follow the same Dirichlet distribution, and we estimate distribution parameter of it by moment matching. Cognitive uncertainty brought by the adversarial attacks will be reflected and amplified on the distribution. Experimental results show that the proposed MH-UI framework can outperform all the referred UI methods in the adversarial attack detection task with different settings.


title: CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context

abstract: While pre-trained language models (LM) for code have achieved great success in code completion, they generate code conditioned only on the contents within the file, i.e., in-file context, but ignore the rich semantics in other files within the same project, i.e., cross-file context, a critical source of information that is especially useful in modern modular software development. Such overlooking constrains code language models' capacity in code completion, leading to unexpected behaviors such as generating hallucinated class member functions or function calls with unexpected arguments. In this work, we develop a cross-file context finder tool, CCFINDER, that effectively locates and retrieves the most relevant cross-file context. We propose CoCoMIC, a framework that incorporates cross-file context to learn the in-file and cross-file context jointly on top of pretrained code LMs. CoCoMIC successfully improves the existing code LM with a 33.94% relative increase in exact match and a 28.69% relative increase in identifier matching for code completion when the cross-file context is provided.


title: Enhancing Task Bot Engagement with Synthesized Open-Domain Dialog

abstract: Many efforts have been made to construct dialog systems for different types of conversations, such as task-oriented dialog (TOD) and open-domain dialog (ODD). To better mimic human-level conversations that usually fuse various dialog modes, it is essential to build a system that can effectively handle both TOD and ODD and access different knowledge sources. To address the lack of available data for the fused task, we propose a framework for automatically generating dialogues that combine knowledge-grounded ODDs and TODs in various settings. Additionally, we introduce a unified model PivotBot that is capable of appropriately adopting TOD and ODD modes and accessing different knowledge sources in order to effectively tackle the fused task. Evaluation results demonstrate the superior ability of the proposed model to switch seamlessly between TOD and ODD tasks.


title: Isothermal and isentropic speed of sound in (2+1)-flavor QCD at non-zero baryon chemical potential

abstract: Recently interest in calculations of the speed of sound in QCD under conditions like constant temperature $c^2_T$ or constant entropy per net baryon number $c^2_s$ arose in the discussion of experimental results coming from heavy ion experiments. It has been stressed that the former in particular is closely related to higher order cumulants of conserved charge fluctuations that are calculated in lattice QCD. We present here results on $c^2_T$ and $c^2_s$ and compare results at vanishing strangeness chemical potential and vanishing net strangeness number with hadron resonance gas model calculations. We stress the difference of both observables at low temperature arising from the light meson sector, which does not contribute to $c^2_T$.


title: Identifying latent distances with Finslerian geometry

abstract: Riemannian geometry provides us with powerful tools to explore the latent space of generative models while preserving the underlying structure of the data. The latent space can be equipped it with a Riemannian metric, pulled back from the data manifold. With this metric, we can systematically navigate the space relying on geodesics defined as the shortest curves between two points. Generative models are often stochastic, causing the data space, the Riemannian metric, and the geodesics, to be stochastic as well. Stochastic objects are at best impractical, and at worst impossible, to manipulate. A common solution is to approximate the stochastic pullback metric by its expectation. But the geodesics derived from this expected Riemannian metric do not correspond to the expected length-minimising curves. In this work, we propose another metric whose geodesics explicitly minimise the expected length of the pullback metric. We show this metric defines a Finsler metric, and we compare it with the expected Riemannian metric. In high dimensions, we prove that both metrics converge to each other at a rate of $O\left(\frac{1}{D}\right)$. This convergence implies that the established expected Riemannian metric is an accurate approximation of the theoretically more grounded Finsler metric. This provides justification for using the expected Riemannian metric for practical implementations.


title: PLUE: Language Understanding Evaluation Benchmark for Privacy Policies in English

abstract: Privacy policies provide individuals with information about their rights and how their personal information is handled. Natural language understanding (NLU) technologies can support individuals and practitioners to understand better privacy practices described in lengthy and complex documents. However, existing efforts that use NLU technologies are limited by processing the language in a way exclusive to a single task focusing on certain privacy practices. To this end, we introduce the Privacy Policy Language Understanding Evaluation (PLUE) benchmark, a multi-task benchmark for evaluating the privacy policy language understanding across various tasks. We also collect a large corpus of privacy policies to enable privacy policy domain-specific language model pre-training. We evaluate several generic pre-trained language models and continue pre-training them on the collected corpus. We demonstrate that domain-specific continual pre-training offers performance improvements across all tasks.


title: Language Modeling with Latent Situations

abstract: Language models (LMs) often generate incoherent outputs: they refer to events and entity states that are incompatible with the state of the world described in their inputs. We introduce SituationSupervision, a family of approaches for improving coherence in LMs by training them to construct and condition on explicit representations of entities and their states. SituationSupervision has two components: an auxiliary situation modeling task that trains models to predict state representations in context, and a latent state inference procedure that imputes these states from partially annotated training data. SituationSupervision can be applied to both fine-tuning (by supervising LMs to encode state variables in their hidden representations) and prompting (by inducing LMs to interleave textual descriptions of entity states with output text). In both cases, SituationSupervision requires only a small number of state annotations to produce major coherence improvements (between 4-11%), showing that standard LMs can be sample-efficiently trained to model not just language but the situations it describes.


title: DocAsRef: An Empirical Study on Repurposing Reference-Based Summary Quality Metrics Reference-Freely

abstract: Automated summary quality assessment falls into two categories: reference-based and reference-free. Reference-based metrics, historically deemed more accurate due to the additional information provided by human-written references, are limited by their reliance on human input. In this paper, we hypothesize that the comparison methodologies used by some reference-based metrics to evaluate a system summary against its corresponding reference can be effectively adapted to assess it against its source document, thereby transforming these metrics into reference-free ones. Experimental results support this hypothesis. After being repurposed reference-freely, the zero-shot BERTScore using the pretrained DeBERTa-large-MNLI model of <0.5B parameters consistently outperforms its original reference-based version across various aspects on the SummEval and Newsroom datasets. It also excels in comparison to most existing reference-free metrics and closely competes with zero-shot summary evaluators based on GPT-3.5.


title: A Generalization of the Geroch Conjecture with Arbitrary Ends

abstract: Using $\mu$-bubbles, we prove that for $3 \le n \le 7$, the connected sum of a Schoen-Yau-Schick $n$-manifold with an arbitrary manifold does not admit a complete metric of positive scalar curvature. When either $3 \le n \le 5$, $1 \le m \le n-1$ or $6 \le n \le 7$, $m \in \{1, n-2, n-1\}$, we also show the connected sum $(M^{n-m}\times \mathbb{T}^m) \# X^n$ where $X$ is an arbitrary manifold does not admit a metric of positive $m$-intermediate curvature. Here $m$-intermediate curvature is a new notion of curvature introduced by Brendle, Hirsch and Johne interpolating between Ricci and scalar curvature.


title: Benchmarking Spatial Relationships in Text-to-Image Generation

abstract: Spatial understanding is a fundamental aspect of computer vision and integral for human-level reasoning about images, making it an important component for grounded language understanding. While recent text-to-image synthesis (T2I) models have shown unprecedented improvements in photorealism, it is unclear whether they have reliable spatial understanding capabilities. We investigate the ability of T2I models to generate correct spatial relationships among objects and present VISOR, an evaluation metric that captures how accurately the spatial relationship described in text is generated in the image. To benchmark existing models, we introduce a dataset, $\mathrm{SR}_{2D}$, that contains sentences describing two or more objects and the spatial relationships between them. We construct an automated evaluation pipeline to recognize objects and their spatial relationships, and employ it in a large-scale evaluation of T2I models. Our experiments reveal a surprising finding that, although state-of-the-art T2I models exhibit high image quality, they are severely limited in their ability to generate multiple objects or the specified spatial relations between them. Our analyses demonstrate several biases and artifacts of T2I models such as the difficulty with generating multiple objects, a bias towards generating the first object mentioned, spatially inconsistent outputs for equivalent relationships, and a correlation between object co-occurrence and spatial understanding capabilities. We conduct a human study that shows the alignment between VISOR and human judgement about spatial understanding. We offer the $\mathrm{SR}_{2D}$ dataset and the VISOR metric to the community in support of T2I reasoning research.


title: The isentropic equation of state of (2+1)-flavor QCD: An update based on high precision Taylor expansion and Pad\'e-resummed expansion at finite chemical potentials

abstract: The HotQCD Collaboration performed Taylor expansion calculations in 2017 for the pressure, energy density, and entropy density at non-zero chemical potentials up to the $6^{th}$ order. Since then, they have significantly improved the statistics for lattices with temporal extents of $N_\tau=8$ and $12$, and have also included results for $N_\tau=16$ that were not previously available. They have also calculated the $8^{th}$-order expansion coefficients for $N_\tau=8$. These calculations showed that the Taylor series expansion for the pressure is accurate up to $\mu_B / T \leq 2.5$. In this study, we use the high-statistics results on Taylor expansion coefficients, calculated with HISQ fermions and extrapolated to the continuum limit, to determine the QCD equation of state under conditions relevant for hot and dense matter produced in heavy ion collisions. We also calculate the energy density and pressure along lines of constant entropy per net baryon number.


title: Unveiling Code Pre-Trained Models: Investigating Syntax and Semantics Capacities

abstract: Past research has examined how well these models grasp code syntax, yet their understanding of code semantics still needs to be explored. We extensively analyze seven code models to investigate how code models represent code syntax and semantics. This includes four prominent code pre-trained models (CodeBERT, GraphCodeBERT, CodeT5, and UnixCoder) and three large language models (StarCoder, CodeLlama, and CodeT5+). We have developed four probing tasks to evaluate the models' abilities to learn code syntax and semantics. These tasks focus on reconstructing code syntax and semantic structures-such as AST, CFG, CDG, and DDG - within the models' representation spaces. These structures are fundamental to understanding code. Additionally, we explore the role of syntax tokens in each token representation and the extended dependencies among code tokens. Furthermore, we examine the distribution of attention weights concerning code semantic structures. Through detailed analysis, our results emphasize the strengths and weaknesses of various code models in mastering code syntax and semantics. The findings reveal that these models are proficient in grasping code syntax, effectively capturing the relationships and roles of syntax tokens. However, their ability to encode code semantics shows more variability. This study enriches our understanding of the capabilities of code models in analyzing syntax and semantics. Our findings offer valuable insights for future code model enhancements, helping optimize their application across a range of code-related tasks.


title: DIONYSUS: A Pre-trained Model for Low-Resource Dialogue Summarization

abstract: Dialogue summarization has recently garnered significant attention due to its wide range of applications. However, existing methods for summarizing dialogues have limitations because they do not take into account the inherent structure of dialogue and rely heavily on labeled data, which can lead to poor performance in new domains. In this work, we propose DIONYSUS (dynamic input optimization in pre-training for dialogue summarization), a pre-trained encoder-decoder model for summarizing dialogues in any new domain. To pre-train DIONYSUS, we create two pseudo summaries for each dialogue example: one is produced by a fine-tuned summarization model, and the other is a collection of dialogue turns that convey important information. We then choose one of these pseudo summaries based on the difference in information distribution across different types of dialogues. This selected pseudo summary serves as the objective for pre-training DIONYSUS using a self-supervised approach on a large dialogue corpus. Our experiments show that DIONYSUS outperforms existing methods on six datasets, as demonstrated by its ROUGE scores in zero-shot and few-shot settings.


title: When Do Decompositions Help for Machine Reading?

abstract: Answering complex questions often requires multi-step reasoning in order to obtain the final answer. Most research into decompositions of complex questions involves open-domain systems, which have shown success in using these decompositions for improved retrieval. In the machine reading setting, however, work to understand when decompositions are helpful is understudied. We conduct experiments on decompositions in machine reading to unify recent work in this space, using a range of models and datasets. We find that decompositions can be helpful in the few-shot case, giving several points of improvement in exact match scores. However, we also show that when models are given access to datasets with around a few hundred or more examples, decompositions are not helpful (and can actually be detrimental). Thus, our analysis implies that models can learn decompositions implicitly even with limited data.


title: On the Blind Spots of Model-Based Evaluation Metrics for Text Generation

abstract: In this work, we explore a useful but often neglected methodology for robustness analysis of text generation evaluation metrics: stress tests with synthetic data. Basically, we design and synthesize a wide range of potential errors and check whether they result in a commensurate drop in the metric scores. We examine a range of recently proposed evaluation metrics based on pretrained language models, for the tasks of open-ended generation, translation, and summarization. Our experiments reveal interesting insensitivities, biases, or even loopholes in existing metrics. For example, we find that BERTScore is confused by truncation errors in summarization, and MAUVE (built on top of GPT-2) is insensitive to errors at the beginning or middle of generations. Further, we investigate the reasons behind these blind spots and suggest practical workarounds for a more reliable evaluation of text generation. We have released our code and data at https://github.com/cloudygoose/blindspot_nlg.


title: Finite temperature QCD phase transition with 3 flavors of M\"obius domain wall fermions

abstract: We investigate the finite temperature QCD phase transition with three degenerate quark flavors using M\"{o}bius domain wall fermions. To explore the order of phase transition on the lower left corner of Columbia plot and if possible, to locate the critical endpoint we performed simulations at temperatures around 181 and 121 MeV with lattice spacing $a=0.1361(20)$ fm corresponding to temporal lattice extent $N_{\tau}=8,12$ with varying quark mass for two different volumes with aspect ratios $N_{\sigma}/N_{\tau}$ ranging from 2 to 3. By analyzing the volume and mass dependence of the chiral condensate, disconnected chiral susceptibility and Binder cumulant we find that there is a crossover at $m_q^{\mathrm{\overline {MS}}}(2\, \mathrm{GeV}) \sim 44\, \mathrm{MeV}$ for $\mathrm{T_{pc}}\sim$ 181 MeV, At temperature 121 MeV, the binder cumulant suggests a crossover at $m_q^{\mathrm{\overline {MS}}}(2\, \mathrm{GeV}) \sim 3.7\, \mathrm{MeV}$, although a study of volume dependence would be important to confirm this.


title: Cosmological stability in $f(\phi,{\cal G})$ gravity

abstract: In gravitational theories where a canonical scalar field $\phi$ with a potential $V(\phi)$ is coupled to a Gauss-Bonnet (GB) term ${\cal G}$ with the Lagrangian $f(\phi,{\cal G})$, we study the cosmological stability of tensor and scalar perturbations in the presence of a perfect fluid. We show that, in decelerating cosmological epochs with a positive tensor propagation speed squared, the existence of nonlinear functions of ${\cal G}$ in $f$ always induces Laplacian instability of a dynamical scalar perturbation associated with the GB term. This is also the case for $f({\cal G})$ gravity, where the presence of nonlinear GB functions $f({\cal G})$ is not allowed during the radiation- and matter-dominated epochs. A linearly coupled GB term with $\phi$ of the form $\xi (\phi){\cal G}$ can be consistent with all the stability conditions, provided that the scalar-GB coupling is subdominant to the background cosmological dynamics.


title: Covariant Riesz transform on differential forms for $1<p\leq2$

abstract: In this paper, we study $L^p$-boundedness ($1<p\leq 2$) of the covariant Riesz transform on differential forms for a class of non-compact weighted Riemannian manifolds without assuming conditions on derivatives of curvature. We present in particular a local version of $L^p$-boundedness of Riesz transforms under two natural conditions, namely the curvature-dimension condition, and a lower bound on the Weitzenb\"{o}ck curvature endomorphism. As an application, the Calder\'on-Zygmund inequality for $1< p\leq 2$ on weighted manifolds is derived under the curvature-dimension condition as hypothesis.


title: Active sampling: A machine-learning-assisted framework for finite population inference with optimal subsamples

abstract: Data subsampling has become widely recognized as a tool to overcome computational and economic bottlenecks in analyzing massive datasets. We contribute to the development of adaptive design for estimation of finite population characteristics, using active learning and adaptive importance sampling. We propose an active sampling strategy that iterates between estimation and data collection with optimal subsamples, guided by machine learning predictions on yet unseen data. The method is illustrated on virtual simulation-based safety assessment of advanced driver assistance systems. Substantial performance improvements are demonstrated compared to traditional sampling methods.


title: When Federated Learning Meets Pre-trained Language Models' Parameter-Efficient Tuning Methods

abstract: With increasing privacy concerns on data, recent studies have made significant progress using federated learning (FL) on privacy-sensitive natural language processing (NLP) tasks. Much literature suggests fully fine-tuning pre-trained language models (PLMs) in the FL paradigm can mitigate the data heterogeneity problem and close the performance gap with centralized training. However, large PLMs bring the curse of prohibitive communication overhead and local model adaptation costs for the FL system. To this end, we introduce various parameter-efficient tuning (PETuning) methods into federated learning. Specifically, we provide a holistic empirical study of representative PLMs tuning methods in FL. The experimental results cover the analysis of data heterogeneity levels, data scales, and different FL scenarios. Overall communication overhead can be significantly reduced by locally tuning and globally aggregating lightweight model parameters while maintaining acceptable performance in various FL settings. To facilitate the research of PETuning in FL, we also develop a federated tuning framework FedPETuning, which allows practitioners to exploit different PETuning methods under the FL training paradigm conveniently. The source code is available at \url{https://github.com/iezhuozhuo/FedETuning/tree/deltaTuning}.


title: Resonantly Enhanced Electric-Field Sensing of Etchless Thin Film Lithium Niobate via Quasibound Sates in the Continuum

abstract: Electric field detection has been widely utilized in many fields such as scientific research and integrated circuits. To enhance the tuning sensitivity of E-field sensor, in this paper, we theoretically proposed a highly sensitive E-field sensor composed of etchless lithium niobate (LN) material and hybrid coupling-grating systems in the visible near-infrared regime. Such configuration supports high-quality factor quasi-BIC resonance, which generates strong localized field confinement. Due to the large electro-optic coefficient of LN material, one can shift the wavelength and reflection ratio of resonance by tuning the refractive index of LN material. An analytical theory is carried out to explain the relationship between the refractive index variations and the applied voltages, so we successfully obtained a tuning sensitivity of 40.8 nm/V and a minimum detectable electric field amplitude of 24.5 mV with wavelength resolution of 1 nm. Due to the low parasitic capacitance of LN material and high conductivity of gold film and ITO layer which are utilized as the electrodes, the 3dB bandwidth of the devices should exceed 154 GHz. And we believe that such a surface-normal E-field sensor has extensive potential for the extremely weak electric field detection.


title: Search for heavy Majorana neutrinos at future lepton colliders

abstract: The nonzero neutrino mass can be a signal for new physics beyond the standard model. To explain the tiny neutrino mass, we can extend the standard model with right-handed Majorana neutrinos in a low-scale seesaw mechanism, while the CP violation effect can be induced due to the CP phase in the interference of heavy Majorana neutrinos. The existence of heavy Majorana neutrinos may lead to lepton number violation processes, which can be used as a probe to search for the signal of heavy Majorana neutrinos. In this paper, we focus on the CP violation effect related to two generations of heavy Majorana neutrinos for $15$ GeV $<m_N<$ $70$ GeV in the pair production of W bosons and rare decays. It is valuable to investigate the Majorana neutrino production signals and the related CP violation effects in the W boson rare decays at future lepton colliders.


title: A novel test of gravity via black hole eikonal correspondence

abstract: When adopted in black hole spacetimes, geometric-optics approximations imply a mapping between the quasinormal mode (QNM) spectrum of black holes in the eikonal limit and black hole images. In particular, the real part and the imaginary part of eikonal QNM frequencies are associated with the apparent size and the detailed structure of the ring images, respectively. This correspondence could be violated when going beyond general relativity. We propose a novel method to test the eikonal correspondence via the comparison of two sets of observables from a nonrotating black hole, one extracted from QNM spectra and the other from the lensed photon rings on the image plane. Specifically, the photon ring observables robustly capture the information of the black hole spacetime itself regardless of the surrounding emission models. Therefore, the proposed test of eikonal correspondence can be validated in quite broad scenarios.


title: Do language models have coherent mental models of everyday things?

abstract: When people think of everyday things like an egg, they typically have a mental image associated with it. This allows them to correctly judge, for example, that "the yolk surrounds the shell" is a false statement. Do language models similarly have a coherent picture of such everyday things? To investigate this, we propose a benchmark dataset consisting of 100 everyday things, their parts, and the relationships between these parts, expressed as 11,720 "X relation Y?" true/false questions. Using these questions as probes, we observe that state-of-the-art pre-trained language models (LMs) like GPT-3 and Macaw have fragments of knowledge about these everyday things, but do not have fully coherent "parts mental models" (54-59% accurate, 19-43% conditional constraint violation). We propose an extension where we add a constraint satisfaction layer on top of the LM's raw predictions to apply commonsense constraints. As well as removing inconsistencies, we find that this also significantly improves accuracy (by 16-20%), suggesting how the incoherence of the LM's pictures of everyday things can be significantly reduced.


title: InterMulti:Multi-view Multimodal Interactions with Text-dominated Hierarchical High-order Fusion for Emotion Analysis

abstract: Humans are sophisticated at reading interlocutors' emotions from multimodal signals, such as speech contents, voice tones and facial expressions. However, machines might struggle to understand various emotions due to the difficulty of effectively decoding emotions from the complex interactions between multimodal signals. In this paper, we propose a multimodal emotion analysis framework, InterMulti, to capture complex multimodal interactions from different views and identify emotions from multimodal signals. Our proposed framework decomposes signals of different modalities into three kinds of multimodal interaction representations, including a modality-full interaction representation, a modality-shared interaction representation, and three modality-specific interaction representations. Additionally, to balance the contribution of different modalities and learn a more informative latent interaction representation, we developed a novel Text-dominated Hierarchical High-order Fusion(THHF) module. THHF module reasonably integrates the above three kinds of representations into a comprehensive multimodal interaction representation. Extensive experimental results on widely used datasets, (i.e.) MOSEI, MOSI and IEMOCAP, demonstrate that our method outperforms the state-of-the-art.


title: Dissipativity of nonlinear ODE model of distribution voltage profile

abstract: In this paper, we consider a power distribution system consisting of a straight feeder line. A nonlinear ordinary differential equation (ODE) model is used to describe the voltage distribution profile over the feeder line. At first, we show the dissipativity of the subsystems corresponding to active and reactive powers. We also show that the dissipation rates of these subsystem coincide with the distribution loss given by a square of current amplitudes. Moreover, the entire distribution system is decomposed into two subsystems corresponding to voltage amplitude and phase. As a main result, we prove the dissipativity of these subsystems based on the decomposition. As a physical interpretation of these results, we clarify that the phenomena related to the gradients of the voltage amplitude and phase are induced in a typical power distribution system from the dissipation equalities. Finally, we discuss a reduction of distribution losses by injecting a linear combination of the active and reactive powers as a control input based on the dissipation rate of the subsystem corresponding to voltage amplitude.


title: Real-time Health Monitoring of Heat Exchangers using Hypernetworks and PINNs

abstract: We demonstrate a Physics-informed Neural Network (PINN) based model for real-time health monitoring of a heat exchanger, that plays a critical role in improving energy efficiency of thermal power plants. A hypernetwork based approach is used to enable the domain-decomposed PINN learn the thermal behavior of the heat exchanger in response to dynamic boundary conditions, eliminating the need to re-train. As a result, we achieve orders of magnitude reduction in inference time in comparison to existing PINNs, while maintaining the accuracy on par with the physics-based simulations. This makes the approach very attractive for predictive maintenance of the heat exchanger in digital twin environments.


title: Unsynchronized Reconfigurable Intelligent Surfaces with Pulse-Width-Based Design

abstract: In this correspondence, we present a reconfigurable intelligent surface (RIS) that reflects an incident signal to the desired direction, depending on the pulse width. This unique reconfigurability emerges by virtue of the transient response of the embedded nonlinear circuits within the RIS unit cells. The RIS does not need any control lines connected to the unit cells or precise synchronization with the base station, leading to reduced complexity of the RIS system yet allowing automated beamforming characteristics in accordance with the incident pulse width. To verify this scheme, an RIS system model using binary phase shift keying is considered, in which the RIS wireless link is connected to a single transmitter at the input and two receivers at the output. Numerical demonstrations show that modulated signals are received with contrasting bit-error rates in the two receivers, consistent with the aforementioned pulse-width-based beam control.


title: Persistence and asymptotic analysis of solutions of nonlinear wave equations

abstract: We consider persistence properties of solutions for a generalised wave equation including vibration in elastic rods and shallow water models, such as the BBM, the Dai's, the Camassa-Holm, and the Dullin-Gottwald-Holm equations, as well as some recent shallow water equations with the Coriolis effect. We establish unique continuation results and exhibit asymptotic profiles for the solutions of the general class considered. From these results we prove the non-existence of non-trivial spatially compactly supported solutions for the equation. As an aftermath, we study the equations earlier mentioned in light of our results for the general class.


title: Efficient Liquidity Providing via Margin Liquidity

abstract: The limit order book mechanism has been the core trading mechanism of the modern financial market. In the cryptocurrency market, centralized exchanges also adopt this limit order book mechanism and a centralized matching engine dynamically connects the traders to the orders of market makers. Recently, decentralized exchanges have been introduced and received considerable attention in the cryptocurrency community. A decentralized exchange typically adopts an automated market maker, which algorithmically arbitrates the trades between liquidity providers and traders through a pool of crypto assets. Meanwhile, the liquidity of the exchange is the most important factor when traders choose an exchange. However, the amount of liquidity provided by the liquidity providers in decentralized exchanges is insufficient when compared to centralized exchanges. This is because the liquidity providers in decentralized exchanges suffer from the risk of divergence loss inherent to the automated market making system. To this end, we introduce a new concept called margin liquidity and leverage this concept to propose a highly profitable margin liquidity-providing position. Then, we extend this margin liquidity-providing position to a virtual margin liquidity-providing position to alleviate the risk of divergence loss for the liquidity providers and encourage them to provide more liquidity to the pool. Furthermore, we introduce a representative strategy for the margin liquidity-providing position and backtest the strategy with historical data from the BTC/ETH market. Our strategy outperforms a simple holding baseline. We also show that our proposed margin liquidity is 8K times more capital efficient than the concentrated liquidity proposed in Uniswap V3.


title: Multi-coil MRI by analytic continuation

abstract: We present novel reconstruction and stability analysis methodologies for two-dimensional, multi-coil MRI, based on analytic continuation ideas. We show that the 2-D, limited-data MRI inverse problem, whereby the missing parts of $\textbf{k}$-space (Fourier space) are lines parallel to either $k_1$ or $k_2$ (i.e., the $\textbf{k}$-space axis), can be reduced to a set of 1-D Fredholm type inverse problems. The Fredholm equations are then solved to recover the 2-D image on 1-D line profiles (``slice-by-slice" imaging). The technique is tested on a range of medical in vivo images (e.g., brain, spine, cardiac), and phantom data. Our method is shown to offer optimal performance, in terms of structural similarity, when compared against similar methods from the literature, and when the $\textbf{k}$-space data is sub-sampled at random so as to simulate motion corruption. In addition, we present a Singular Value Decomposition (SVD) and stability analysis of the Fredholm operators, and compare the stability properties of different $\textbf{k}$-space sub-sampling schemes (e.g., random vs uniform accelerated sampling).


title: A New Period Determination Method for Periodic Variable Stars

abstract: Variable stars play a key role in understanding the Milky Way and the universe. The era of astronomical big data presents new challenges for quick identification of interesting and important variable stars. Accurately estimating the periods is the most important step to distinguish different types of variable stars. Here, we propose a new method of determining the variability periods. By combining the statistical parameters of the light curves, the colors of the variables, the window function and the GLS algorithm, the aperiodic variables are excluded and the periodic variables are divided into eclipsing binaries and NEB variables (other types of periodic variable stars other than eclipsing binaries), the periods of the two main types of variables are derived. We construct a random forest classifier based on 241,154 periodic variables from the ASAS-SN and OGLE datasets of variables. The random forest classifier is trained on 17 features, among which 11 are extracted from the light curves and 6 are from the Gaia Early DR3, ALLWISE and 2MASS catalogs. The variables are classified into 7 superclasses and 17 subclasses. In comparison with the ASAS-SN and OGLE catalogs, the classification accuracy is generally above approximately 82% and the period accuracy is 70%-99%. To further test the reliability of the new method and classifier, we compare our results with the results of Chen et al. (2020) for ZTF DR2. The classification accuracy is generally above 70%. The period accuracy of the EW and SR variables is 50% and 53%, respectively. And the period accuracy of other types of variables is 65%-98%.


title: Improved detection statistics for non Gaussian gravitational wave stochastic backgrounds

abstract: In a recent paper we described a novel approach to the detection and parameter estimation of a non-Gaussian stochastic background of gravitational waves. In this work we propose an improved version of the detection procedure, preserving robustness against imperfect noise knowledge at no cost of detection performance: in the previous approach, the solution proposed to ensure robustness reduced the performances of the detection statistics, which in some cases (namely, mild non-Gaussianity) could be outperformed by Gaussian ones established in literature. We show, through a simple toy model, that the new detection statistic performs better than the previous one (and than the Gaussian statistic) everywhere in the parameter space. It approaches the optimal Neyman-Pearson statistics monotonically with increasing non-Gaussianity and/or number of detectors. In this study we discuss in detail its efficiency. This is a second, important step towards the implementation of a nearly--optimal detection procedure for a realistic non-Gaussian stochastic background. We discuss the relevance of results obtained in the context of the toy model used, and their importance for understanding a more realistic scenario.


title: A Twitter BERT Approach for Offensive Language Detection in Marathi

abstract: Automated offensive language detection is essential in combating the spread of hate speech, particularly in social media. This paper describes our work on Offensive Language Identification in low resource Indic language Marathi. The problem is formulated as a text classification task to identify a tweet as offensive or non-offensive. We evaluate different mono-lingual and multi-lingual BERT models on this classification task, focusing on BERT models pre-trained with social media datasets. We compare the performance of MuRIL, MahaTweetBERT, MahaTweetBERT-Hateful, and MahaBERT on the HASOC 2022 test set. We also explore external data augmentation from other existing Marathi hate speech corpus HASOC 2021 and L3Cube-MahaHate. The MahaTweetBERT, a BERT model, pre-trained on Marathi tweets when fine-tuned on the combined dataset (HASOC 2021 + HASOC 2022 + MahaHate), outperforms all models with an F1 score of 98.43 on the HASOC 2022 test set. With this, we also provide a new state-of-the-art result on HASOC 2022 / MOLD v2 test set.


title: Spin Nematics Meet Spin Liquids: Exotic Quantum Phases in the Spin-$1$ Bilinear-Biquadratic Model with Kitaev Interactions

abstract: Spin liquid crystals are magnetic analogs of liquid crystals, possessing properties of both liquids and solids, a typical example of which are spin nematics. Spin nematics share many features with spin liquids, and the interplay between them is a promising, but little explored, route to uncovering new phases of matter. Here, we address this question in the context of a spin-$1$ magnet on the honeycomb lattice, by considering a model with both biquadratic interactions, favouring spin-nematic states, and Kitaev-like interactions, supporting spin liquids. Accompanying these, where dipole and quadrupole moments compete, we find a plethora of exotic phases, including multiple-$q$ states with nonzero scalar spin chirality; a quasi-one-dimensional coplanar phase; a twisted conical phase; and a noncoplanar order state which gives way to a chiral spin liquid at finite temperature. The implication of these results for experiment is discussed.


title: An approach to Set-Valued Anti-Homomorphism of T-Rough Ideals on $\Gamma$-Semigroups

abstract: In this paper, the concepts of set-valued anti-homomorphism and strong set-valued anti-homomorphism of $\Gamma$-semigroup are introduced. The notions of generalized lower and upper approximation operators, constructed by means of set-valued mapping, which is a generalization of the notion of lower and upper approximation of $\Gamma$-semigroup, are provided. Some significant properties of lower and upper approximations of $\Gamma$-semigroup under (strong)set-valued anti-homomorphisms are discussed. We provide examples for the properties of lower and upper approximations of $\Gamma$-semigroup under (strong)set-valued anti-homomorphisms. This article explores the notion of a set-valued anti-homomorphism for $\Gamma$-semigroups, which is a generalization of anti-homomorphism in general


title: A Rigorous Framework for Automated Design Assessment and Type I Error Control: Methods and Demonstrative Examples (Working Paper)

abstract: We present a proof-by-simulation framework for rigorously controlling a trial design's operating characteristics over continuous regions of parameter space. We show that proof-by-simulation can achieve two major goals: (1) Calibrate a design for provable Type I Error control at a fixed level alpha. (2) Given a fixed design, bound (with high probability) its operating characteristics, such as the Type I Error, FDR, or bias of bounded estimators. This framework can handle adaptive sampling, nuisance parameters, administrative censoring, multiple arms, and multiple testing. These techniques, which we call Continuous Simu lation Extension (CSE), were first developed in Sklar (2021) to control Type I Error and FWER for designs where unknown parameters have exponential family likelihood. Our appendix improves those results with more efficient bounding and calibration methods, extends them to general operating characteristics including FDR and bias, and extends applicability to include canonical GLMs and some non-parametric problems. In the main paper we demonstrate our CSE approach and software on 3 examples (1) a gentle introduction, analyzing the z-test (2) a hierarchical Bayesian analysis of 4 treatments, with sample sizes fixed (3) an adaptive Bayesian Phase II-III selection design with 4 arms, where interim dropping and go/no-go decisions are based on a hierarchical model. Trillions of simulations were performed for the latter two examples, enabled by specialized INLA software. Open-source software is maintained at (1)


title: Shinning Light on Sterile Neutrino Portal Dark Matter from Cosmology and Collider

abstract: Provided the dark sector consisted of a dark scalar $\phi$ and a dark fermion $\chi$ under an exact $Z_2$ symmetry, the sterile neutrino $N$ can act as the messenger between the dark sector and standard model via the Yukawa coupling $\lambda_{ds} \bar{\chi}\phi N$. In this paper, we focus on the specific scenario $m_N>m_\phi+m_\chi$ with $\chi$ being a FIMP dark matter. The decay width of dark scalar $\phi$ is doubly suppressed by the smallness of Yukawa coupling $\lambda_{ds}$ and mixing angle $\theta$. The delayed decay $\phi\to\chi\nu$ will have a great impact on cosmological observables such as the Big Bang Nucleosynthesis, the Cosmic Microwave Background anisotropy power spectra, the effective number of relativistic neutrino species $N_{\rm eff}$ and the energetic neutrino flux. Meanwhile, the sterile neutrino can generate displaced vertex signature at colliders when $m_N<m_W$. The dark scalar $\phi$ will also induce measurable Higgs invisible decay for relatively large quartic coupling. A comprehensive analysis of constraints from cosmology and collider is performed in this paper. We find that almost the whole parameter space with $m_N<m_W$ is under the reach of future experiments.


title: Simple Supergravity

abstract: We present a short overview of the structure and couplings of supergravity theories at the component level. We do so with as little technical machinery as possible, working directly with the physical on-shell fields and using explicit computations and geometrical reasoning to arrive at the result, highlighting the new properties of supersymmetry in the context of a gravitational theory.


title: On extremal Sombor index of trees with a given independence number $\alpha$

abstract: The Sombor index is a topological index in graph theory defined by Gutman in 2021. In this article, we find the maximum Sombor index of trees of order $\mathbf{n}$ with a given independence number $\alpha$, where $\ceil*{\frac{\mathbf{n}}{2}} \leq \alpha(G) \leq \mathbf{n}-1$. We also provide the unique graph among the chosen class where the maximum Sombor index is attained.


title: Causal Inference for Knowledge Graph based Recommendation

abstract: Knowledge Graph (KG), as a side-information, tends to be utilized to supplement the collaborative filtering (CF) based recommendation model. By mapping items with the entities in KGs, prior studies mostly extract the knowledge information from the KGs and inject it into the representations of users and items. Despite their remarkable performance, they fail to model the user preference on attributes in the KG, since they ignore that (1) the structure information of KG may hinder the user preference learning, and (2) the user's interacted attributes will result in the bias issue on the similarity scores. With the help of causality tools, we construct the causal-effect relation between the variables in KG-based recommendation and identify the reasons causing the mentioned challenges. Accordingly, we develop a new framework, termed Knowledge Graph-based Causal Recommendation (KGCR), which implements the deconfounded user preference learning and adopts counterfactual inference to eliminate bias in the similarity scoring. Ultimately, we evaluate our proposed model on three datasets, including Amazon-book, LastFM, and Yelp2018 datasets. By conducting extensive experiments on the datasets, we demonstrate that KGCR outperforms several state-of-the-art baselines, such as KGNN-LS, KGAT and KGIN.


title: An Augmentation Strategy for Visually Rich Documents

abstract: Many business workflows require extracting important fields from form-like documents (e.g. bank statements, bills of lading, purchase orders, etc.). Recent techniques for automating this task work well only when trained with large datasets. In this work we propose a novel data augmentation technique to improve performance when training data is scarce, e.g. 10-250 documents. Our technique, which we call FieldSwap, works by swapping out the key phrases of a source field with the key phrases of a target field to generate new synthetic examples of the target field for use in training. We demonstrate that this approach can yield 1-7 F1 point improvements in extraction performance.


abstract: Bilevel optimization plays an essential role in many machine learning tasks, ranging from hyperparameter optimization to meta-learning. Existing studies on bilevel optimization, however, focus on either centralized or synchronous distributed setting. The centralized bilevel optimization approaches require collecting massive amount of data to a single server, which inevitably incur significant communication expenses and may give rise to data privacy risks. Synchronous distributed bilevel optimization algorithms, on the other hand, often face the straggler problem and will immediately stop working if a few workers fail to respond. As a remedy, we propose Asynchronous Distributed Bilevel Optimization (ADBO) algorithm. The proposed ADBO can tackle bilevel optimization problems with both nonconvex upper-level and lower-level objective functions, and its convergence is theoretically guaranteed. Furthermore, it is revealed through theoretic analysis that the iteration complexity of ADBO to obtain the $\epsilon$-stationary point is upper bounded by $\mathcal{O}(\frac{1}{{{\epsilon ^2}}})$. Thorough empirical studies on public datasets have been conducted to elucidate the effectiveness and efficiency of the proposed ADBO.


title: OBMO: One Bounding Box Multiple Objects for Monocular 3D Object Detection

abstract: Compared to typical multi-sensor systems, monocular 3D object detection has attracted much attention due to its simple configuration. However, there is still a significant gap between LiDAR-based and monocular-based methods. In this paper, we find that the ill-posed nature of monocular imagery can lead to depth ambiguity. Specifically, objects with different depths can appear with the same bounding boxes and similar visual features in the 2D image. Unfortunately, the network cannot accurately distinguish different depths from such non-discriminative visual features, resulting in unstable depth training. To facilitate depth learning, we propose a simple yet effective plug-and-play module, \underline{O}ne \underline{B}ounding Box \underline{M}ultiple \underline{O}bjects (OBMO). Concretely, we add a set of suitable pseudo labels by shifting the 3D bounding box along the viewing frustum. To constrain the pseudo-3D labels to be reasonable, we carefully design two label scoring strategies to represent their quality. In contrast to the original hard depth labels, such soft pseudo labels with quality scores allow the network to learn a reasonable depth range, boosting training stability and thus improving final performance. Extensive experiments on KITTI and Waymo benchmarks show that our method significantly improves state-of-the-art monocular 3D detectors by a significant margin (The improvements under the moderate setting on KITTI validation set are $\mathbf{1.82\sim 10.91\%}$ \textbf{mAP in BEV} and $\mathbf{1.18\sim 9.36\%}$ \textbf{mAP in 3D}). Codes have been released at \url{https://github.com/mrsempress/OBMO}.


title: Favorable band alignment for photocatalysis at the strontium germanate interface with silicon

abstract: Photocatalytic water splitting is a promising strategy for large-scale clean energy production. However, efficient and low-cost solid-state photocatalysts are still lacking. We present here first-principles calculations to investigate the suitability as photocathode of an epitaxial layer of strontium germanate on a Si(100) single crystal. Conduction and valence bands offsets at the interface between these two semiconductors were determined using state-of-the-art approximations of density functional theory for the accurate prediction of band alignments. The resulting type-III band line-up is also confirmed by inspection of the spatially resolved density of states. It is concluded that the electronic structure of the investigated heterostructure is favorable for photocathodic functionality.


title: A Framework of Customer Review Analysis Using the Aspect-Based Opinion Mining Approach

abstract: Opinion mining is the branch of computation that deals with opinions, appraisals, attitudes, and emotions of people and their different aspects. This field has attracted substantial research interest in recent years. Aspect-level (called aspect-based opinion mining) is often desired in practical applications as it provides detailed opinions or sentiments about different aspects of entities and entities themselves, which are usually required for action. Aspect extraction and entity extraction are thus two core tasks of aspect-based opinion mining. his paper has presented a framework of aspect-based opinion mining based on the concept of transfer learning. on real-world customer reviews available on the Amazon website. The model has yielded quite satisfactory results in its task of aspect-based opinion mining.


title: Characteristic Gluing with $\Lambda$ 1. Linearised Einstein equations on four-dimensional spacetimes

abstract: We establish a gluing theorem for linearised vacuum gravitational fields in Bondi gauge on a class of characteristic surfaces in static vacuum four-dimensional backgrounds with cosmological constant $\Lambda \in \mathbb{R}$ and arbitrary topology of the compact cross-sections of the null hypersurface. This generalises and complements, in the linearised case, the pioneering analysis of Aretakis, Czimek and Rodnianski, carried-out on light-cones in Minkowski spacetime.


title: Dynamic spending and portfolio decisions with a soft social norm

abstract: We explore the implications of a preference ordering for an investor-consumer with a strong preference for keeping consumption above an exogenous social norm, but who is willing to tolerate occasional dips below it. We do this by splicing two CRRA preference orderings, one with high curvature below the norm and the other with low curvature at or above it. We find this formulation appealing for many endowment funds and sovereign wealth funds, including the Norwegian Government Pension Fund Global, which inspired our research. We solve this model analytically as well as numerically and find that annual spending should not only be significantly lower than the expected financial return, but mostly also procyclical. In particular, financial losses should, as a rule, be followed by larger than proportional spending cuts, except when some smoothing is needed to keep spending from falling too far below the social norm. Yet, at very low wealth levels, spending should be kept particularly low in order to build sufficient wealth to raise consumption above the social norm. Financial risk taking should also be modest and procyclical, so that the investor sometimes may want to "buy at the top" and "sell at the bottom". Many of these features are shared by habitformation models and other models with some lower bound for consumption. However, our specification is more flexible and thus more easily adaptable to actual fund management. The nonlinearity of the policy functions may present challenges regarding delegation to professional managers. However, simpler rules of thumb with constant or slowly moving equity share and consumption-wealth ratio can reach almost the same expected discounted utility. However, the constant levels will then look very different from the implications of expected CRRA utility or Epstein-Zin preferences in that consumption is much lower.


title: VoronoiPatches: Evaluating A New Data Augmentation Method

abstract: Overfitting is a problem in Convolutional Neural Networks (CNN) that causes poor generalization of models on unseen data. To remediate this problem, many new and diverse data augmentation methods (DA) have been proposed to supplement or generate more training data, and thereby increase its quality. In this work, we propose a new data augmentation algorithm: VoronoiPatches (VP). We primarily utilize non-linear recombination of information within an image, fragmenting and occluding small information patches. Unlike other DA methods, VP uses small convex polygon-shaped patches in a random layout to transport information around within an image. Sudden transitions created between patches and the original image can, optionally, be smoothed. In our experiments, VP outperformed current DA methods regarding model variance and overfitting tendencies. We demonstrate data augmentation utilizing non-linear re-combination of information within images, and non-orthogonal shapes and structures improves CNN model robustness on unseen data.


title: Direct and inverse problems for a third order self-adjoint differential operator with periodic boundary conditions and nonlocal potential

abstract: A third order self-adjoint differential operator with periodic boundary conditions and an one-dimensional perturbation has been considered. For this operator, we first show that the spectrum consists of simple eigenvalues and finitely many eigenvalues of multiplicity two. Then the expressions of eigenfunctions and resolvent are described. Finally, the inverse problems for recovering all the components of the one-dimensional perturbation are solved. In particular, we prove the Ambarzumyan-type theorem and show that the even or odd potential can be reconstructed by three spectra.


title: The [S II] Spectral Images of the Planetary Nebula NGC 7009: II. Major Axis

abstract: We derived position-velocity density distribution diagrams along the major (PA = 77$^{\circ}$) axis of the elliptical planetary nebula NGC 7009 with the Keck HIRES [SII] 6716/6731 \A, doublet spectral images. The average densities of the main shell and knots of NGC 7009 derived from the [SII] 6716/673 \A, fluxes integrated over the line of sight indicate a density range of $N_{\rm e}$ = $10^{3.4}$ to 10$^{3.9}$ $cm^{-3}$, while the local densities from the volume fraction resolved in radial velocities along the line of sight show a considerably large range of about 10$^{2.8}$ -- 10$^{4.7}$ $cm^{-3}$. The derived projection angle of the major axis of the main shell is about $\psi \sim$18.3($\pm$2)$^{\circ}$. Assuming that the main shell is an ellipsoidal shell with $a \simeq$16$''$ and $b \simeq 6''$, we found the range of expansion velocity, radius, and latitude of four knots and a hot bubble. The four knots at the points in symmetrical positions are roughly aligned with the same axis of expansion of latitudes $\phi \sim \pm 34.5(\pm 0.6)^{\circ}$: One pair expands at about 35 $kms^{-1}$ close to the main ellipsoidal shell, and the other expands rapidly at about 60 $kms^{-1}$ at a distance of $r \sim 16''$. In the latitude range $\phi = $65 -- 75$^{\circ}$, the hot bubble of a relatively large structure expands rapidly with a velocity of 130 -- 150 $kms^{-1}$. Four knots and hot bubble points that expand faster than the main shell appear to have been formed by two to three eruptions at a different epoch than the primary structure formation.


title: WeCheck: Strong Factual Consistency Checker via Weakly Supervised Learning

abstract: A crucial issue of current text generation models is that they often uncontrollably generate factually inconsistent text with respective of their inputs. Limited by the lack of annotated data, existing works in evaluating factual consistency directly transfer the reasoning ability of models trained on other data-rich upstream tasks like question answering (QA) and natural language inference (NLI) without any further adaptation. As a result, they perform poorly on the real generated text and are biased heavily by their single-source upstream tasks. To alleviate this problem, we propose a weakly supervised framework that aggregates multiple resources to train a precise and efficient factual metric, namely WeCheck. WeCheck first utilizes a generative model to accurately label a real generated sample by aggregating its weak labels, which are inferred from multiple resources. Then, we train the target metric model with the weak supervision while taking noises into consideration. Comprehensive experiments on a variety of tasks demonstrate the strong performance of WeCheck, which achieves a 3.4\% absolute improvement over previous state-of-the-art methods on TRUE benchmark on average.


title: Recognition and reconstruction of cell differentiation patterns with deep learning

abstract: Cell lineage decisions occur in three-dimensional spatial patterns that are difficult to identify by eye. There is an ongoing effort to replicate such patterns using mathematical modeling. One approach uses long ranging cell-cell communication to replicate common spatial arrangements like checkerboard and engulfing patterns. In this model, the cell-cell communication has been implemented as a signal that disperses throughout the tissue. On the other hand, machine learning models have been developed for pattern recognition and pattern reconstruction tasks. We combined synthetic data generated by the mathematical model with deep learning algorithms to recognize and reconstruct spatial cell fate patterns in organoids of mouse embryonic stem cells. A graph neural network was developed and trained on synthetic data from the model. Application to in vitro data predicted a low signal dispersion value. To test this result, we implemented a multilayer perceptron for the prediction of a given cell fate based on the fates of the neighboring cells. The results show a 70% accuracy of cell fate reconstruction based on the nine nearest neighbors of a cell. Overall, our approach combines deep learning with mathematical modeling to link cell fate patterns with potential underlying mechanisms.


title: CosmoDRAGoN simulations -- I. Dynamics and observable signatures of radio jets in cosmological environments

abstract: We present the Cosmological Double Radio Active Galactic Nuclei (CosmoDRAGoN) project: a large suite of simulated AGN jets in cosmological environments. These environments sample the intra-cluster media of galaxy clusters that form in cosmological smooth particle hydrodynamics (SPH) simulations, which we then use as inputs for grid-based hydrodynamic simulations of radio jets. Initially conical jets are injected with a range of jet powers, speeds (both relativistic and non-relativistic), and opening angles; we follow their collimation and propagation on scales of tens to hundreds of kiloparsecs, and calculate spatially-resolved synthetic radio spectra in post-processing. In this paper, we present a technical overview of the project, and key early science results from six representative simulations which produce radio sources with both core- (Fanaroff-Riley Type I) and edge-brightened (Fanaroff-Riley Type II) radio morphologies. Our simulations highlight the importance of accurate representation of both jets and environments for radio morphology, radio spectra, and feedback the jets provide to their surroundings.


title: I Cast Detect Thoughts: Learning to Converse and Guide with Intents and Theory-of-Mind in Dungeons and Dragons

abstract: We propose a novel task, G4C, to study teacher-student natural language interactions in a goal-driven and grounded environment. Dungeons and Dragons (D&D), a role-playing game, provides an ideal setting to investigate such interactions. Here, the Dungeon Master (DM), i.e., the teacher, guides the actions of several players -- students, each with their own personas and abilities -- to achieve shared goals grounded in a fantasy world. Our approach is to decompose and model these interactions into (1) the DM's intent to guide players toward a given goal; (2) the DM's guidance utterance to the players expressing this intent; and (3) a theory-of-mind (ToM) model that anticipates the players' reaction to the guidance one turn into the future. We develop a novel reinforcement learning (RL) method for training a DM that generates guidance for players by rewarding utterances where the intent matches the ToM-anticipated player actions. Human and automated evaluations show that a DM trained to explicitly model intents and incorporate ToM of the players using RL generates better-quality guidance that is 3x more likely to fulfill the DM's intent than a vanilla natural language generation (NLG) approach.


title: Area law for steady states of detailed-balance local Lindbladians

abstract: We study steady-states of quantum Markovian processes whose evolution is described by local Lindbladians. We assume that the Lindbladian is gapped and satisfies quantum detailed balance with respect to a unique full-rank steady state $\sigma$. We show that under mild assumptions on the Lindbladian terms, which can be checked efficiently, the Lindbladian can be mapped to a local Hamiltonian on a doubled Hilbert space that has the same spectrum, and a ground state that is the vectorization of $\sigma^{1/2}$. Consequently, we can use Hamiltonian complexity tools to study the steady states of such open systems. In particular, we show an area-law in the mutual information for the steady state of such 1D systems, together with a tensor-network representation that can be found efficiently.

categories: quant-ph math-ph math.MP physics.atom-ph


title: 360$^\circ$ Stereo Image Composition with Depth Adaption

abstract: 360$^\circ$ images and videos have become an economic and popular way to provide VR experiences using real-world content. However, the manipulation of the stereo panoramic content remains less explored. In this paper, we focus on the 360$^\circ$ image composition problem, and develop a solution that can take an object from a stereo image pair and insert it at a given 3D position in a target stereo panorama, with well-preserved geometry information. Our method uses recovered 3D point clouds to guide the composited image generation. More specifically, we observe that using only a one-off operation to insert objects into equirectangular images will never produce satisfactory depth perception and generate ghost artifacts when users are watching the result from different view directions. Therefore, we propose a novel view-dependent projection method that segments the object in 3D spherical space with the stereo camera pair facing in that direction. A deep depth densification network is proposed to generate depth guidance for the stereo image generation of each view segment according to the desired position and pose of the inserted object. We finally merge the synthesized view segments and blend the objects into the target stereo 360$^\circ$ scene. A user study demonstrates that our method can provide good depth perception and removes ghost artifacts. The view-dependent solution is a potential paradigm for other content manipulation methods for 360$^\circ$ images and videos.


title: Coherence properties of light in highly multimoded nonlinear parabolic fibers under optical equilibrium conditions

abstract: We study the coherence characteristics of light propagating in nonlinear graded-index multimode fibers after attaining optical thermal equilibrium conditions. The role of optical temperature on the spatial mutual coherence function and the associated correlation area is systematically investigated. In this respect, we show that the coherence properties of the field at the output of a multimode nonlinear fiber can be controlled through its optical thermodynamic properties.


title: AdverSAR: Adversarial Search and Rescue via Multi-Agent Reinforcement Learning

abstract: Search and Rescue (SAR) missions in remote environments often employ autonomous multi-robot systems that learn, plan, and execute a combination of local single-robot control actions, group primitives, and global mission-oriented coordination and collaboration. Often, SAR coordination strategies are manually designed by human experts who can remotely control the multi-robot system and enable semi-autonomous operations. However, in remote environments where connectivity is limited and human intervention is often not possible, decentralized collaboration strategies are needed for fully-autonomous operations. Nevertheless, decentralized coordination may be ineffective in adversarial environments due to sensor noise, actuation faults, or manipulation of inter-agent communication data. In this paper, we propose an algorithmic approach based on adversarial multi-agent reinforcement learning (MARL) that allows robots to efficiently coordinate their strategies in the presence of adversarial inter-agent communications. In our setup, the objective of the multi-robot team is to discover targets strategically in an obstacle-strewn geographical area by minimizing the average time needed to find the targets. It is assumed that the robots have no prior knowledge of the target locations, and they can interact with only a subset of neighboring robots at any time. Based on the centralized training with decentralized execution (CTDE) paradigm in MARL, we utilize a hierarchical meta-learning framework to learn dynamic team-coordination modalities and discover emergent team behavior under complex cooperative-competitive scenarios. The effectiveness of our approach is demonstrated on a collection of prototype grid-world environments with different specifications of benign and adversarial agents, target locations, and agent rewards.


title: Bulk reconstruction of AdS$_{d+1}$ metrics and developing kinematic space

abstract: The metrics of the global, Poincar\'e, and Rindler AdS$_{d+1}$ are explicitly reconstructed with given lightcone cuts. We first compute the metric up to a conformal factor with the lightcone cuts method introduced by Engelhardt and Horowitz. While a general prescription to determine the conformal factor is not known, we recover the factor by identifying the causal information surfaces from the lightcone cuts and finding that they are minimal. In addition, we propose a new type of kinematic space as the space of minimal surfaces in AdS$_{d+1}$, where a metric is introduced as a generalization of the case of $d=2$. This metric defines the set of bulk points, which is equivalent to that of lightcone cuts. Some other properties are also studied towards establishing a reconstruction procedure for general bulk metrics.


title: RepMode: Learning to Re-parameterize Diverse Experts for Subcellular Structure Prediction

abstract: In biological research, fluorescence staining is a key technique to reveal the locations and morphology of subcellular structures. However, it is slow, expensive, and harmful to cells. In this paper, we model it as a deep learning task termed subcellular structure prediction (SSP), aiming to predict the 3D fluorescent images of multiple subcellular structures from a 3D transmitted-light image. Unfortunately, due to the limitations of current biotechnology, each image is partially labeled in SSP. Besides, naturally, subcellular structures vary considerably in size, which causes the multi-scale issue of SSP. To overcome these challenges, we propose Re-parameterizing Mixture-of-Diverse-Experts (RepMode), a network that dynamically organizes its parameters with task-aware priors to handle specified single-label prediction tasks. In RepMode, the Mixture-of-Diverse-Experts (MoDE) block is designed to learn the generalized parameters for all tasks, and gating re-parameterization (GatRep) is performed to generate the specialized parameters for each task, by which RepMode can maintain a compact practical topology exactly like a plain network, and meanwhile achieves a powerful theoretical topology. Comprehensive experiments show that RepMode can achieve state-of-the-art overall performance in SSP.


title: Search for light dark matter with ionization signals in the PandaX-4T Experiment

abstract: We report the search results of light dark matter through its interactions with shell electrons and nuclei, using the commissioning data from the PandaX-4T liquid xenon detector. Low energy events are selected to have an ionization-only signal between 60 to 200 photoelectrons, corresponding to a mean nuclear recoil energy from 0.77 to 2.54 keV and electronic recoil energy from 0.07 to 0.23 keV. With an effective exposure of 0.55 tonne$\cdot$year, we set the most stringent limits within a mass range from 40 $\rm{MeV/c^2}$ to 10 $\rm{GeV/c^2}$ for point-like dark matter-electron interaction, 100 MeV/c$^2$ to 10 GeV/c$^2$ for dark matter-electron interaction via a light mediator, and 3.2 to 4 $\rm{GeV/c^2}$ for dark matter-nucleon spin-independent interaction. For DM interaction with electrons, our limits are closing in on the parameter space predicted by the freeze-in and freeze-out mechanisms in the early Universe.


title: The assignments of the $B_s$ mesons within the screened potential model and $^3P_0$ model

abstract: We investigate the mass spectrum and the decay properties of the $B_s$ mesons within the screened nonrelativistic quark model and the $^3P_0$ model. Our results suggest that the $B_{sJ}(6064)$ and $B_{sJ}(6114)$ states, as the first solution of the recently LHCb measurements, could be explained as the $B_s(1^3D_3)$ and $B_s(1^3D_1)$, respectively. In addition, the $B_{sJ}(6109)$ and $B_{sJ}(6158)$ states, as the second solution of the LHCb measurements, could be explained as the $B'_{s2}(1D)$ and $B_{s1}(2P)$, respectively. Meanwhile, the $B_{s1}(5830)$ could be interpreted as the candidate of the $B_{s1}(1P)$. We also calculated the decay properties of the other excited $B_s$ mesons with the predicted masses, which should be helpful for the experimental searching in future.


title: $N$-factor complexity of the infinite Fibonacci sequence and digital sequences

abstract: In this paper, we introduce a variation of the factor complexity, called the $N$-factor complexity, which allows us to characterize the complexity of sequences on an infinite alphabet. We evaluate precisely the $N$-factor complexity for the infinite Fibonacci sequence $\mathbf{f}$ given by Zhang, Wen and Wu [Electron. J. Comb., 24 (2017)]. The $N$-factor complexity of a class of digit sequences, whose $n$th term is defined to be the number of occurrences of a given block in the base-$k$ representation of $n$, is also discussed.


title: A Framework for Fair Decision-making Over Time with Time-invariant Utilities

abstract: Fairness is a major concern in contemporary decision problems. In these situations, the objective is to maximize fairness while preserving the efficacy of the underlying decision-making problem. This paper examines repeated decisions on problems involving multiple stakeholders and a central decision maker. Repetition of the decision-making provides additional opportunities to promote fairness while increasing the complexity from symmetry to finding solutions. This paper presents a general mathematical programming framework for the proposed fairness-over-time (FOT) decision-making problem. The framework includes a natural abstraction of how a stakeholder's acquired utilities can be aggregated over time. In contrast with a natural, descriptive formulation, we demonstrate that if the aggregation function possesses certain basic properties, a strong reformulation can be written to remove symmetry from the problem, making it amenable to branch-and-cut solvers. Finally, we propose a particular relaxation of this reformulation that can assist in the construction of high-quality approximate solutions to the original problem and can be solved using simultaneous row and column generation techniques.


title: Large Language Models Are Reasoning Teachers

abstract: Recent works have shown that chain-of-thought (CoT) prompting can elicit language models to solve complex reasoning tasks, step-by-step. However, prompt-based CoT methods are dependent on very large models such as GPT-3 175B which are prohibitive to deploy at scale. In this paper, we use these large models as reasoning teachers to enable complex reasoning in smaller models and reduce model size requirements by several orders of magnitude. We propose Fine-tune-CoT, a method that generates reasoning samples from very large teacher models to fine-tune smaller models. We evaluate our method on a wide range of public models and complex tasks. We find that Fine-tune-CoT enables substantial reasoning capability in small models, far outperforming prompt-based baselines and even the teacher model in many tasks. Additionally, we extend our method by leveraging the teacher model's ability to generate multiple distinct rationales for each original sample. Enriching the fine-tuning data with such diverse reasoning results in a substantial performance boost across datasets, even for very small models. We conduct ablations and sample studies to understand the emergence of reasoning capabilities of student models. Our code implementation and data are available at https://github.com/itsnamgyu/reasoning-teacher.


title: Identifying hot subdwarf stars from photometric data using Gaussian mixture model and graph neural network

abstract: Hot subdwarf stars are very important for understanding stellar evolution, stellar astrophysics, and binary star systems. Identifying more such stars can help us better understand their statistical distribution, properties, and evolution. In this paper, we present a new method to search for hot subdwarf stars in photometric data (b, y, g, r, i, z) using a machine learning algorithm, graph neural network, and Gaussian mixture model. We use a Gaussian mixture model and Markov distance to build the graph structure, and on the graph structure, we use a graph neural network to identify hot subdwarf stars from 86 084 stars, when the recall, precision, and f1 score are maximized on the original, weight and synthetic minority oversampling technique datasets. Finally, from 21 885 candidates, we selected approximately 6 000 stars that were the most similar to the hot subdwarf star.


title: Simultaneous Factors Selection and Fusion of Their Levels in Penalized Logistic Regression

abstract: Nowadays, several data analysis problems require for complexity reduction, mainly meaning that they target at removing the non-influential covariates from the model and at delivering a sparse model. When categorical covariates are present, with their levels being dummy coded, the number of parameters included in the model grows rapidly, fact that emphasizes the need for reducing the number of parameters to be estimated. In this case, beyond variable selection, sparsity is also achieved through fusion of levels of covariates which do not differentiate significantly in terms of their influence on the response variable. In this work a new regularization technique is introduced, called $L_{0}$-Fused Group Lasso ($L_{0}$-FGL) for binary logistic regression. It uses a group lasso penalty for factor selection and for the fusion part it applies an $L_{0}$ penalty on the differences among the levels' parameters of a categorical predictor. Using adaptive weights, the adaptive version of $L_{0}$-FGL method is derived. Theoretical properties, such as the existence, $\sqrt{n}$ consistency and oracle properties under certain conditions, are established. In addition, it is shown that even in the diverging case where the number of parameters $p_{n}$ grows with the sample size $n$, $\sqrt{n}$ consistency and a consistency in variable selection result are achieved. Two computational methods, PIRLS and a block coordinate descent (BCD) approach using quasi Newton, are developed and implemented. A simulation study supports that $L_{0}$-FGL shows an outstanding performance, especially in the high dimensional case.


title: 'Virtual pivot point' in human walking: always experimentally observed but simulations suggest it may not be necessary for stability

abstract: The intersection of ground reaction forces near a point above the center of mass has been observed in computer simulation models and human walking experiments. Observed so ubiquitously, the intersection point (IP) is commonly assumed to provide postural stability for bipedal walking. In this study, we challenge this assumption by questioning if walking without an IP is possible. Deriving gaits with a neuromuscular reflex model through multi-stage optimization, we found stable walking patterns that show no signs of the IP-typical intersection of ground reaction forces. The non-IP gaits found are stable and successfully rejected step-down perturbations, which indicates that an IP is not necessary for locomotion robustness or postural stability. A collision-based analysis shows that non-IP gaits feature center of mass (CoM) dynamics with vectors of the CoM velocity and ground reaction force increasingly opposing each other, indicating an increased mechanical cost of transport. Although our computer simulation results have yet to be confirmed through experimental studies, they already indicate that the role of the IP in postural stability should be further investigated. Moreover, our observations on the CoM dynamics and gait efficiency suggest that the IP may have an alternative or additional function that should be considered.


title: Improving the quality of neural TTS using long-form content and multi-speaker multi-style modeling

abstract: Neural text-to-speech (TTS) can provide quality close to natural speech if an adequate amount of high-quality speech material is available for training. However, acquiring speech data for TTS training is costly and time-consuming, especially if the goal is to generate different speaking styles. In this work, we show that we can transfer speaking style across speakers and improve the quality of synthetic speech by training a multi-speaker multi-style (MSMS) model with long-form recordings, in addition to regular TTS recordings. In particular, we show that 1) multi-speaker modeling improves the overall TTS quality, 2) the proposed MSMS approach outperforms pre-training and fine-tuning approach when utilizing additional multi-speaker data, and 3) long-form speaking style is highly rated regardless of the target text domain.


title: Out-of-sample scoring and automatic selection of causal estimators

abstract: Recently, many causal estimators for Conditional Average Treatment Effect (CATE) and instrumental variable (IV) problems have been published and open sourced, allowing to estimate granular impact of both randomized treatments (such as A/B tests) and of user choices on the outcomes of interest. However, the practical application of such models has ben hampered by the lack of a valid way to score the performance of such models out of sample, in order to select the best one for a given application. We address that gap by proposing novel scoring approaches for both the CATE case and an important subset of instrumental variable problems, namely those where the instrumental variable is customer acces to a product feature, and the treatment is the customer's choice to use that feature. Being able to score model performance out of sample allows us to apply hyperparameter optimization methods to causal model selection and tuning. We implement that in an open source package that relies on DoWhy and EconML libraries for implementation of causal inference models (and also includes a Transformed Outcome model implementation), and on FLAML for hyperparameter optimization and for component models used in the causal models. We demonstrate on synthetic data that optimizing the proposed scores is a reliable method for choosing the model and its hyperparameter values, whose estimates are close to the true impact, in the randomized CATE and IV cases. Further, we provide examles of applying these methods to real customer data from Wise.


title: DOC: Improving Long Story Coherence With Detailed Outline Control

abstract: We propose the Detailed Outline Control (DOC) framework for improving long-range plot coherence when automatically generating several-thousand-word-long stories. DOC consists of two complementary components: a detailed outliner and a detailed controller. The detailed outliner creates a more detailed, hierarchically structured outline, shifting creative burden from the main drafting procedure to the planning stage. The detailed controller ensures the more detailed outline is still respected during generation by controlling story passages to align with outline details. In human evaluations of automatically generated stories, DOC substantially outperforms a strong Re3 baseline (Yang et al., 2022) on plot coherence (22.5% absolute gain), outline relevance (28.2%), and interestingness (20.7%). Humans also judged DOC to be much more controllable in an interactive generation setting.